Displays and information input devices

ABSTRACT

An integrated display and input device including a pixel array operative to provide a visually sensible output, at least one sensor operative to sense at least a position of at least one object with respect to the pixel array when the at least one object has at least a predetermined degree of propinquity to the pixel array and circuitry receiving an output from the at least one sensor and providing a non-imagewise input representing the position of the at least one object relative to the pixel array to utilization circuitry.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a 35 USC §371 US National Phase applicationof PCT/IL2007/000332.

The present application is related to U.S. Provisional PatentApplication No. 60/789,188, filed Apr. 3, 2006 and entitled USERINTERFACE FUNCTIONALITIES, the disclosure of which are hereby,incorporated by reference and priority of which is hereby claimedpursuant to 37 CFR 1.78(a) (4) and (5)(i).

The present application is also related to U.S. Provisional PatentApplication No. 60/715,546, filed Sep. 8, 2005 and entitled OPTICALSENSOR FOR MEASUREMENT OF LIGHT SCATTERING and to U.S. ProvisionalPatent Application No. 60/734,027 filed Nov. 3, 2005, and entitledCONTROL APPARATUS, the disclosures of which are hereby incorporated byreference.

The present application is also related to U.S. Provisional PatentApplication No. 60/682,604, filed May 18, 2005 and entitled NOVELDISTORTION LENS, U.S. Patent Application Publication No. 2005/0156914A1and to PCT Application Publication No. WO 2005/094176, the disclosuresof which are hereby incorporated by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to displays, information input devices anduser interface functionalities.

2. Description of the Related Art

The following published patent documents, the disclosures of which arehereby incorporated by reference, are believed to represent the currentstate of the art:

Great Britain Patent Numbers: GB2299856 and GB2289756; European PatentNumber: EP0572182;

PCT Patent Application Publication Numbers: WO02/043045, WO03/104965 A2;WO 2005/094176 A3; WO95/02801 & WO 2005/094176; and

U.S. Pat. Nos. 6,404,416; 6,094,188; 6,081,255; 5,926,168; 892,501;5,448,261; 5,227,985; 5,949,402; 5,959,617; 5,122,656; 5,506,605 and,320,292;

U.S. Patent Publication Nos.: US 2001/0050672 & 2005/0156914A1.

SUMMARY OF THE INVENTION

The present invention seeks to provide an integrated display and inputdevice, improved user interfaces and user interface functionalities,particularly useful for displays, such as those employed with computers,televisions, personal communicators and other mobile devices.

There is thus provided in accordance with a preferred embodiment of thepresent invention an integrated display and input device including apixel array operative to provide a visually sensible output, at leastone sensor operative to sense at least a position of at least one objectwith respect to the pixel array when the at least one object has atleast a predetermined degree of propinquity to the pixel array andcircuitry receiving an output from the at least one sensor and providinga non-imagewise input representing the position of the at least oneobject relative to the pixel array to utilization circuitry. Preferably,the integrated display and input device also includes at least one IRilluminator for illuminating the at least one object when it has the atleast a predetermined degree of propinquity to the pixel array.Additionally, the at least one illuminator also functions as at leastone backlighting illuminator associated with the pixel array.Alternatively or additionally, the at least one illuminator is locatedin a plane coplanar with or parallel to the at least one sensor.

Preferably, the at least one illuminator is located generally in thesame plane as at least one backlighting illuminator associated with thepixel array.

Preferably, the at least one sensor senses light reflected from the atleast one object. Additionally, the at least one sensor senses ambientlight reflected from the at least one object. Alternatively oradditionally, the at least one sensor senses IR light reflected from theat least one object.

Preferably, the at least one object is at least one finger.Alternatively or additionally, the at least one object is at least onelocated device.

Preferably, the integrated display and input device also includesutilization circuitry.

Preferably, the utilization circuitry provides chording functionality.Additionally or alternatively, the utilization circuitry providesfunctionality to distinguish at least between positions of the at leastone object when touching and not touching the device. Alternatively oradditionally, the utilization circuitry provides functionality todistinguish at least between directions of motion of the at least oneobject towards and away from the device as well as directions of motionlaterally thereof.

Preferably, the utilization circuitry provides functionality to computeat least one characteristic of a trajectory of motion of the at leastone object generally parallel to the pixel array. Additionally, the atleast one characteristic includes at least one of location, direction,velocity and change in direction. Preferably, the utilization circuitryprovides functionality for panning and scrolling. Alternatively oradditionally, the utilization circuitry provides functionality forone-handed zooming.

Preferably, the utilization circuitry provides functionality foremploying a sensed distinction between instances when the at least oneobject touches and does not touch the device. Additionally oralternatively, the utilization circuitry provides functionality formouse over and click. Preferably mouse over functionality is providedwhen a user's finger is not touching a screen or other object but withina predetermined range of propinquity. In such a case, mouse clickfunctionality is provided when a user's finger touches the screen orother object. In a preferred case, within the predetermined range ofpropinquity, the extent of propinquity is not of significance, howeveralternatively, the extent of propinquity may be sensed and utilized invarious functionalities, as described herein below.

Alternatively or additionally, the utilization circuitry providesfunctionality for turning pages. Additionally or alternatively, theutilization circuitry provides functionality for gaining. Additionallyor alternatively, the utilization circuitry provides functionalityutilizing differences in sensed relative positions of a user's fingers.Alternatively or additionally, the utilization circuitry providesinteractive television functionality. Additionally or alternatively, theutilization circuitry provides portable computer functionality.Preferably, the at least one sensor includes a plurality of detectorelements arranged in a plane parallel to a viewing plane. Additionallyor alternatively, the at least one sensor is coplanar with the pixelarray.

Preferably, each of the pixel array and the at least one sensor includea plurality of elements arranged in parallel planes, parallel to aviewing plane.

Preferably, the at least one sensor includes a detector assemblyarranged at least one edge of a viewing plane defining plate.Additionally, the detector assembly is arranged about the at least oneedge of the viewing plane defining plate.

Alternatively, the detector assembly is arranged along the at least oneedge of the viewing plane defining plate.

Preferably, the detector assembly includes a support substrate and anarrangement of detector elements. Additionally, the detector assemblyalso includes a cover layer. Additionally, the support substrate isintegrated with a housing of the integrated display and input device.

Preferably, the arrangement of detector elements includes a plurality ofdiscrete single-element detectors. Alternatively, the arrangement ofdetector elements includes an integrally formed multi-element detectorarray. In another alternative embodiment, the arrangement of detectorelements includes a plurality of discrete multi-element detectors.

Preferably, the cover layer is formed of a light transmissive material.

Alternatively, the cover layer includes a mask having apertures definedtherein. In another alternative embodiment, the cover layer includes afield-of-view defining mask having light-collimating tunnel-definingapertures. Additionally or alternatively, the cover layer includeslenses.

Preferably, the at least one edge includes a mask having aperturesdefined therein. Alternatively, the at least one edge includes afield-of-view defining mask having light-collimating tunnel-definingapertures. Alternatively or additionally, the at least one edge includeslenses.

Preferably, the at least one sensor includes a plurality of generallyforward-facing detectors arranged about edges of a display element.

Preferably, at least one detector in the arrangement detectselectromagnetic radiation at a baseline level and senses the position ofthe object with respect to the pixel array and the circuitry providesthe non-image wise input according to location of at least one detectorin the arrangement for which at least one of the amount of radiationdetected and the change in the amount of radiation detected exceed afirst predetermined threshold. Additionally, the change in the amount ofradiation detected results from at least one detector in the arrangementdetecting reflected light from the object in addition to detecting theradiation at the baseline level.

Preferably, the reflected light propagates within the viewing planedefining plate to at least one detector in the arrangement.Alternatively, the reflected light propagates above the viewing planedefining plate to at least one detector in the arrangement. In anotheralternative embodiment the reflected light is transmitted through theviewing plane defining plate directly to at least one detector in thearrangement. Preferably, the at least one detector in the arrangementdetects radiation at the baseline level, senses the position of theobject with respect to the pixel array and the circuitry provides thenon-imagewise input according to location of at least one detector inthe arrangement at which the amount of radiation detected is below asecond predetermined threshold. Preferably, the integrated display andinput device also includes a processing subassembly including detectoranalyzing processing circuitry operative to receive detector outputs ofindividual detectors in the arrangement, to determine at least one ofwhether the amount of radiation detected by the individual detectorsexceeds the first predetermined threshold, whether the change in theamount of radiation detected by the individual detectors exceeds thefirst predetermined threshold and whether the amount of radiationdetected by the individual detectors is below the second predeterminedthreshold, and to provide detector analysis outputs for the individualdetectors, array processing circuitry operative to receive the detectoranalysis outputs of individual detectors in the arrangement and togenerate an array detection output therefrom and position determiningcircuitry operative to receive the array detection output of thearrangement and to determine the position of the object therefrom.

Preferably, the array detection output includes informationcorresponding to the location of an impingement point of the object onthe viewing plane defining plate. Alternatively, the array detectionoutput includes information corresponding to the location of the objectrelative to the viewing plane defining plate.

Preferably, the radiation at the baseline level is provided by at leastone source of illumination external to the integrated display and inputdevice. Additionally, the at least one source of illumination includesat least one of sunlight, artificial room lighting and IR illuminationemitted from a human body.

Preferably, the integrated display and input device also includes anillumination subassembly operative to provide illumination foraugmenting the radiation at the baseline level. Alternatively, theintegrated display and input device also includes an illuminationsubassembly operative to provide the radiation at the baseline level.

Preferably, the illumination subassembly includes at least oneelectromagnetic radiation emitting source. Additionally, the at leastone electromagnetic radiation emitting source includes at least one ofat least one IR emitting LED and at least one visible light emittingLED. Optionally, the light emitted by LED may be modulated by modulatingcircuitry (not shown).

Preferably, the at least one electromagnetic radiation emitting sourceis disposed at an intersection of two mutually perpendicular edges ofthe viewing plane defining plate. Alternatively, the at least oneelectromagnetic radiation emitting source forms part of a lineararrangement of display backlights underlying the viewing plane definingplate.

Preferably, the illumination subassembly includes at least one generallylinear arrangement of a plurality of electromagnetic radiation emittingsources arranged in parallel to at least one edge of the viewing planedefining plate. Additionally, at least one of the at least one generallylinear arrangement is arranged behind the at least one sensor.

There is also provided in accordance with another preferred embodimentof the present invention a position sensing assembly including a platedefining a surface, at least one pixel array including a plurality ofdetector elements detecting electromagnetic radiation at a baselinelevel, the at least one pixel array being operative to sense a positionof an object with respect to the surface according to locations of onesof the plurality of detector elements at which at least one of theamount of radiation detected and the change in the amount of radiationdetected exceed a predetermined threshold, the at least one pixel arraybeing operative to sense at least a position of at least one object withrespect to the at least one pixel array when the at least one object hasat least a predetermined degree of propinquity to the at least one pixelarray and circuitry receiving an output from the at least one pixelarray and providing a non-imagewise input representing the position ofthe at least one object relative to the at least one pixel array toutilization circuitry.

Preferably, the position sensing assembly also includes at least one IRilluminator for illuminating the at least one object when it has the atleast a 5 predetermined degree of propinquity to the at least one pixelarray. Additionally, the at least one illuminator also functions as atleast one backlighting illuminator associated with a display associatedwith the at least one pixel array. Alternatively or additionally, the atleast one illuminator is located in a plane coplanar with or parallel tothe at least pixel array. Optionally, the light emitted by theilluminator may be modulated by 10 modulating circuitry (not shown).

Preferably, the at least one illuminator is located generally in thesame plane as at least one backlighting illuminator. Optionally, thelight emitted by the illuminator may be modulated by modulatingcircuitry (not shown).

Preferably, the at least one pixel array senses light reflected from theat least one object. Additionally, the at least one pixel array sensesambient light reflected from the at least one object. Alternatively oradditionally, the at least one pixel array senses IR light reflectedfrom the at least one object.

Preferably, the at least one object is at least one finger.Alternatively or additionally, the at least one object is at least onelocated device.

Preferably, the position sensing assembly also includes utilizationcircuitry.

Preferably, the utilization circuitry provides chording functionality.Additionally or alternatively, the utilization circuitry providesfunctionality to distinguish at least between positions of the at leastone object when touching and not 5 touching the device. Alternatively oradditionally, the utilization circuitry provides functionality todistinguish at least between directions of motion of the at least oneobject towards and away from the device.

Preferably, the utilization circuitry provides functionality to computeat least one characteristic of a trajectory of motion of the at leastone object generally 0 parallel to the at least one pixel array.Additionally, the at least one characteristic includes at least one oflocation, direction, velocity and change in direction.

Preferably, the utilization circuitry provides functionality for panningand scrolling. Alternatively or additionally, the utilization circuitryprovides functionality for one-handed zooming.

Preferably, the utilization circuitry provides functionality foremploying a sensed distinction between instances when the at least oneobject touches and does not touch the device. Additionally oralternatively, the utilization circuitry provides functionality formouse over and click. Additionally or alternatively, the utilizationcircuitry provides functionality for document browsing including pageturning.

Alternatively or additionally, the utilization circuitry providesfunctionality for gaming. Alternatively or additionally, the utilizationcircuitry provides functionality utilizing differences in sensedrelative positions of a user's fingers.

Preferably, the change in the amount of radiation detected results fromones of the plurality of detector elements detecting reflected lightfrom the object in addition to detecting the radiation at the baselinelevel. Additionally, the reflected light propagates within the plate toones of the plurality of detector elements. Alternatively, the reflectedlight propagates above the surface to ones of the plurality of detectorelements. In another alternative embodiment the reflected light istransmitted through the plate directly to at least one of the pluralityof detector elements.

Preferably, the position sensing assembly also includes a processingsubassembly including detector analyzing processing circuitry operativeto receive detector outputs of individual ones of the plurality ofdetector elements, to determine whether at least one of the amount ofradiation and the change in the amount of radiation detected by theindividual ones of the plurality detector element exceeds thepredetermined threshold, and to provide detector analysis outputs forthe individual ones of the plurality of detector elements, arrayprocessing circuitry operative to receive the detector analysis outputsof the plurality of detector elements of a single one of the at leastone pixel array and to generate an array detection output therefrom andposition determining circuitry operative to receive the array detectionoutput of the at least one pixel array and to determine the position ofthe object therefrom. Preferably, the array detection output includesinformation corresponding to the location of an impingement point of theobject on the surface. Alternatively, the array detection outputincludes information corresponding to the location of the objectrelative to the surface.

Preferably, the position of the object includes at least one of atwo-dimensional position of the object, a three-dimensional position ofthe object and angular orientation of the object.

Preferably, the radiation at the baseline level is provided by at leastone source of radiation external to the position sensing assembly.Additionally, the at least one source of radiation includes at least oneof sunlight, artificial room lighting and IR illumination emitted from ahuman body. Preferably, the position sensing assembly also includes anillumination subassembly operative to provide illumination foraugmenting the radiation at the baseline level. Alternatively, theposition sensing assembly also includes an illumination subassemblyoperative to provide the radiation at the baseline level to theplurality of detector elements. Preferably, the illumination subassemblyincludes at least one electromagnetic radiation emitting source.Additionally, the at least one electromagnetic radiation emitting sourceincludes at least one of at least one IR emitting LED and at least onevisible light emitting LED.

Preferably, the at least one pixel array includes at least two pixelarrays arranged at mutually perpendicular edges of the plate.

Preferably, the illumination subassembly includes an electromagneticradiation emitting source disposed at an intersection of two of the atleast two pixel arrays. Alternatively, the illumination subassemblyincludes an electromagnetic radiation emitting source disposed at anintersection of two mutually perpendicular edges of the plate, andacross from an intersection point of two of the at least two pixelarrays. Alternatively or additionally, the illumination subassemblyincludes at least one electromagnetic radiation emitting source formingpart of a linear arrangement of display backlights underlying the plate.

Preferably, the at least one electromagnetic radiation emitting sourceincludes an IR emitting LED.

Preferably, the illumination subassembly includes at least one generallylinear arrangement of a plurality of electromagnetic radiation emittingsources arranged in parallel to at least one edge of the plate.Additionally, at least one of the at least one generally lineararrangement is arranged behind at least one of the at least two pixelarrays.

Preferably, the at least one pixel array is arranged in a plane parallelto the surface. Additionally, the illumination subassembly includes atleast one generally linear arrangement of a plurality of electromagneticradiation emitting sources arranged in parallel to at least one edge ofthe plate. Alternatively, the illumination subassembly includes anelectromagnetic radiation emitting source disposed at an intersection oftwo mutually perpendicular edges of the plate. Preferably, the at leastone pixel array includes a single pixel array arranged along an edge ofthe plate. Additionally, the illumination subassembly includes anelectromagnetic radiation emitting source disposed at an intersection ofedges of the plate. Alternatively, the illumination subassembly includesat least one electromagnetic radiation emitting source forming part of alinear arrangement of display backlights underlying the plate.

Preferably, the at least one electromagnetic radiation emitting sourceincludes an IR emitting LED.

Preferably, the illumination subassembly includes at least one generallylinear arrangement of a plurality of electromagnetic radiation emittingsources arranged in parallel to at least one edge of the plate.Additionally, at least one of the at least one generally lineararrangement is arranged behind the single pixel array.

It is appreciated that the various embodiments of the present inventiondescribed hereinabove substantially enhance conventional touch screenfunctionality by adding another input dimension. The present inventionthus enables differentiation between various positions of a passiveobject, such as a user's finger, thus distinguishing for example betweena situation wherein a user's finger touches a screen and one or moresituations where the finger is within a propinquity threshold of thescreen. This can obviate the need for an active stylus and enable theuse of a passive stylus or finger control of various functionalities.Particularly advantageous embodiments of the present invention enable afinger touch position to be distinguished from a finger propinquityposition. For example a finger propinquity position may be employed fora mouse over functionality, while a finger touch position may beemployed for a mouse click functionality.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention will be more fully understood and appreciated fromthe following detailed description, taken in conjunction with thedrawings in which:

FIGS. 1A, 1B, 1C and 1D are simplified illustrations of four types ofintegrated display and input devices constructed and operative inaccordance with a preferred embodiment of the present invention;

FIGS. 2A and 2B are simplified illustrations of portions of two types ofintegrated display and input devices constructed and operative inaccordance with another preferred embodiment of the present invention,including detectors arranged in a plane parallel to a viewing plane;

FIGS. 3A and 3B are simplified illustrations of portions of two types ofintegrated display and input devices constructed and operative inaccordance with yet another preferred embodiment of the presentinvention, employing elements arranged in parallel planes, parallel to aviewing plane;

FIG. 4 is a simplified illustration of a portion of an input deviceconstructed and operative in accordance with still another preferredembodiment of the present invention, employing detectors arranged alongedges of a display element;

FIG. 5 is a simplified illustration of a portion of an input deviceconstructed and operative in accordance with a further preferredembodiment of the present invention, employing detectors arranged alongedges of a display element;

FIG. 6 is a simplified illustration of a portion of an input deviceconstructed and operative in accordance with a yet further preferredembodiment of the present invention, employing detectors arranged alongedges of a display element;

FIG. 7 is a simplified illustration of a portion of an input deviceconstructed and operative in accordance with an additional preferredembodiment of the present invention, employing detectors arranged alongedges of a display element;

FIGS. 8A, 8B, 8C and 8D are simplified illustrations of four alternativeembodiments of a portion of an input device constructed and operative inaccordance with another preferred embodiment of the present inventionemploying detectors arranged along edges of a display element;

FIGS. 9A, 9B, 9C and 9D are simplified illustrations of four alternativeembodiments of a portion of an input device constructed and operative inaccordance with yet another preferred embodiment of the presentinvention, employing forward-facing detectors arranged about edges of adisplay element; FIGS. 10A, 10B, 10C and 10D are simplifiedillustrations of four alternative embodiments of a portion of an inputdevice constructed and operative in accordance with still anotherpreferred embodiment of the present invention, employing forward-facingdetectors arranged behind edges of a display element;

FIGS. 11A, 11B, 11C and 11D are simplified•illustrations of fouralternative embodiments of a portion of an input device constructed andoperative in accordance with a further preferred embodiment of thepresent invention, employing forward-facing detectors arranged behindedges of a display element;

FIGS. 12A, 12B, 12C and 12D are simplified illustrations of fouralternative embodiments of a portion of an input device constructed andoperative in accordance with a yet further preferred embodiment of thepresent invention, employing detectors arranged along edges of a displayelement;

FIGS. 13A, 13B, 13C and 13D are simplified illustrations of fouralternative embodiments of a portion of an input device constructed andoperative in accordance with a still further preferred embodiment of thepresent invention, employing detectors arranged along edges of a displayelement;

FIGS. 14A, 14B, 14C and 14D are simplified illustrations of fouralternative embodiments of a portion of an input device constructed andoperative in accordance with an additional preferred embodiment of thepresent invention, employing forward-facing detectors arranged aboutedges of a display element; FIGS. 15A, 15B, 15C and 15D are simplifiedillustrations of four alternative embodiments of a portion of an inputdevice constructed and operative in accordance with another preferredembodiment of the present invention, employing forward-facing detectorsarranged behind edges of a display element;

FIGS. 16A, 16B, 16C and 16D are simplified illustrations of fouralternative embodiments of a portion of an input device constructed andoperative in accordance with yet another preferred embodiment of thepresent invention, employing forward-facing detectors arranged behindedges of a display element;

FIGS. 17A, 17B and 17C are simplified illustrations of three alternativeembodiments of a detector assembly forming part of an integrated displayand input device constructed and operative in accordance with apreferred embodiment of the present invention; FIGS. 18A, 18B, 18C, 18D,18E and 18F are simplified illustrations of six alternative embodimentsof an illumination subassembly forming part of an integrated display andinput device constructed and operative in accordance with a preferredembodiment of the present invention;

FIG. 19 is a simplified illustration of an integrated display and inputdevice constructed and operative in accordance with a preferredembodiment of the present invention, utilizing electromagnetic radiationfrom a source external to the integrated display and input device;

FIGS. 20A, 20B, 21A, 21B and 22 are simplified illustrations of theoperation of an integrated display and input device constructed andoperative in accordance with another preferred embodiment of the presentinvention;

FIGS. 23A, 23B, 23C, 23D and 23E are illustrations of desktop userinterface functionality of a mobile device constructed and operative inaccordance with a preferred embodiment of the present invention;

FIGS. 24A, 24B and 24C are illustrations of browsing functionality of amobile device constructed and operative in accordance with a preferredembodiment of the present invention;

FIGS. 25A and 25B are illustrations of document viewing functionality ofa mobile device constructed and operative in accordance with a preferredembodiment of the present invention; FIGS. 26A, 26B, 26C, 26D and 26Eare illustrations of contact management functionality of a mobile deviceconstructed and operative in accordance with a preferred embodiment ofthe present invention;

FIGS. 27A, 27B, 27C and 27D are illustrations of desktop user interfacefunctionality of a mobile device constructed and operative in accordancewith a preferred embodiment of the present invention;

FIGS. 28A and 28B are illustrations of desktop user interfacefunctionality of a mobile device constructed and operative in accordancewith a preferred embodiment of the present invention;

FIGS. 29A, 29B, 29C, 29D and 29E are illustrations of browsingfunctionality of a mobile device constructed and operative in accordancewith a preferred embodiment of the present invention;

FIGS. 30A, 30B, 30C, 30D, 30E, 30F and 30G are illustrations of contactmanagement functionality of a mobile device constructed and operative inaccordance with another preferred embodiment of the present invention;FIGS. 31A, 31B, 31C, 31D, 31E, 31F and 31G are illustrations of pictureviewing functionality of a mobile device constructed and operative inaccordance with a preferred embodiment of the present invention;

FIGS. 32A, 32B, 32C, 32D, 32E, 32F, 32G and 32H are illustrations ofinteractive television functionality of a mobile device constructed andoperative in accordance with a preferred embodiment of the presentinvention; and

FIGS. 33A, 33B, 33C, 33D, 33E, 33F and 33G are illustrations of mapbrowser functionality of a mobile device constructed and operative inaccordance with a preferred embodiment of the present invention.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

Reference is now made to FIGS. 1A, 1B, 1C and 1D which are simplifiedillustrations of four types of integrated display and input devicesconstructed and operative in accordance with a preferred embodiment ofthe present invention. These devices preferably include a pixel arrayoperative to provide a visually sensible output, at least one sensoroperative to sense at least a position of at least one object withrespect to the pixel array when the at least one object has at least apredetermined degree of propinquity to the pixel array and circuitryreceiving an output from the at least one sensor and providing anon-imagewise input representing the position of the at least one objectrelative to the pixel array to utilization circuitry.

The integrated display and input device may also include at least one IRilluminator for illuminating the at least one object when it has the atleast a predetermined degree of propinquity to the pixel array.Additionally, the illuminator may also function as a backlightingilluminator associated with the pixel array. Alternatively oradditionally, the illuminator may be located in a plane coplanar with orparallel to the at least one sensor.

In another preferred embodiment, the illuminator is located generally inthe same plane as a backlighting illuminator associated with the pixelarray. The sensor is preferably operable to sense light reflected fromone or more object having at least a predetermined degree of propinquityto the pixel array. The light sensed by the at least one sensor may beambient light reflected from the at least one object. Alternatively oradditionally, the light sensed by the at least one sensor may be IRlight reflected from the object. The at least one object may be at leastone finger or at least one located device.

In another preferred embodiment, the integrated display and input devicealso includes utilization circuitry. The utilization circuitrypreferably provides one or more or the following functionalities:chording functionality, functionality to distinguish at least betweenpositions of the at least one object when touching and not touching thedevice, functionality to distinguish at least between directions ofmotion of the at least one object towards and away from the device,functionality to compute at least one characteristic of a trajectory ofmotion of the at least one object generally parallel to the pixel array,the characteristic including at least one of location, direction,velocity and change in direction, functionality for panning andscrolling, functionality for one-handed zooming, functionality foremploying a sensed distinction between instances when the at least oneobject touches and does not touch the device, functionality for mouseover and click, functionality for turning pages, functionality forgaming and functionality utilizing differences in sensed relativepositions of a user's fingers.

FIG. 1A illustrates a mobile telephone 100 having a touch responsiveinput functionality employing light reflection in accordance with apreferred embodiment of the present invention. As seen in FIG. 1A5arrays 102 of light detector elements 104 are arranged along at leasttwo mutually perpendicular edge surfaces 106 of a viewing plane definingplate 108 overlying a keyboard template display 110. Suitable detectorelements are, for example, Solderable Silicon Photodiodes commerciallyavailable from Advanced Photonix Incorporated of Camarillo, Calif.3 USAunder catalog designator PDB-C601-1. Arrays 102 may be provided alongall or most of edge surfaces 106. Alternatively, a single array 102 maybe provided along only one edge surface 106 of plate 108. Viewing planedefining plate 108 may be a single or multiple layer plate and may haveone or more coating layers associated therewith. Light, preferablyincluding light in the IR band, is reflected from a user's finger, astylus (not shown) or any other suitable reflective object, touching orlocated in propinquity to plate 108. The light is propagated withinplate 108 and is detected by detector elements 104. The source of thereflected light is preferably external to the mobile telephone 100, forexample as shown in FIG. 19. Suitable external light sources includesunlight, artificial room lighting and IR illumination emitted from ahuman body or other heat source. In an alternate preferred embodiment,the source of the reflected light may comprise an illuminationsubassembly 112 which typically includes one or more electromagneticradiation emitting sources, here shown as a single IR emitting LED 114.Additional electromagnetic radiation sources 115 may be provided. Theillumination subassembly 112 preferably forms part of the integrateddisplay and input device. Examples of various suitable configurations ofillumination subassembly 112 are described herein below in FIGS.18A-18F. Optionally, the light emitted by LED 114 may be modulated bymodulating circuitry (not shown).

FIG. 1B illustrates a large screen display 120, such as a televisiondisplay, having a light beam responsive input functionality operative inaccordance with a preferred embodiment of the present invention. As seenin FIG. 1B, arrays 122 of generally forward-looking light detectorelements 124 are arranged generally along at least two mutuallyperpendicular edges 126 of display 120. Arrays' 122 may be providedalong all or most of edges 126. Alternatively, a single array 122 may beprovided along only one edge 126 of display 120. Light, preferablyincluding light in the IR band emitted by a light beam emitter 128, isdetected directly by one or more of detector elements 124.

FIG. 1C illustrates a tablet computer 130 having a light beam responsiveinput functionality operative in accordance with a preferred embodimentof the present invention. As seen in FIG. 1C, a multiplicity of lightdetector elements 134 are interspersed among light emitters 136 arrangedin a plane 138. Examples of such a structure are described in U.S. Pat.No. 7,034,866 and U.S. Patent Application Publication Nos.2006/0132463A1, 2006/0007222 A1 and 2004/00012565A1, the disclosures ofwhich are hereby incorporated by reference. Light, preferably includinglight in the IR band, emitted by a light beam emitter 140, propagatesthrough at least one cover layer 142 and is detected by one or more ofdetector elements 134.

FIG. 1D illustrates a display 150 of a digital camera 152 having a touchresponsive input functionality employing light reflection in accordancewith a preferred embodiment of the present invention. As seen in FIG.1D, an array 154 of light detector elements 156 is arranged behind an IRtransmissive display panel 158, such as an LCD or OLED, underlying aviewing plane defining plate 160. Viewing plane defining plate 160 maybe a single or multiple layer plate and may have one or more coatinglayers associated therewith. The array 154 of light detector elements156 may be formed of a plurality of discrete detector arrays mounted ona substrate or integrally formed therewith. Alternatively, the array 154may be formed of one or more CCD or CMOS arrays, or may be created byphotolithography.

Light, preferably including light in the IR band, is reflected from astylus 162, a user's finger (not shown) or any other suitable reflectiveobject, touching or located in propinquity to plate 160. The lightpropagates through plate 160 and panel 158 and is detected by detectorelements 156.

The source of the reflected light is preferably external to the digitalcamera 152, for example as shown in FIG. 19. Suitable external lightsources include sunlight, artificial room lighting and IR illuminationemitted from a human body or other heat source. In an alternatepreferred embodiment, the source of the reflected light may comprise anillumination subassembly, which may include both IR and visible lightemitting LEDs or LEDs having a spectral range which covers both IR andvisible wavelengths. The illumination subassembly typically includes oneor more electromagnetic radiation emitting sources, here shown asmultiple IR emitting LEDs 163, preferably arranged adjacent to the edgesof the display and at least partially behind a front face thereof. Theillumination subassembly preferably forms part of the integrated displayand input device. Examples of various suitable configurations of theillumination subassembly are described herein below in FIGS. 18A-18F.Optionally, the light emitted by LEDs 163 may be modulated by modulatingcircuitry (not shown).

Reference is now made to FIGS. 2A and 2B, which are simplifiedillustrations of portions of two types of integrated display and inputdevices constructed and operative in accordance with another preferredembodiment of the present invention. FIG. 2A shows an integrated displayand input device having touch responsive input functionality, which isuseful for application selection and operation, such as emailcommunication and internet surfing. The input functionality mayincorporate any one or more features of assignee's U.S. ProvisionalPatent Application Nos. 60/715,546; 60/734,027; 60/789,188 and60/682,604, U.S. Patent Application Publication No. 2005/0156914A1 andPCT Patent Application Publication No. WO 2005/094176, the disclosuresof which are hereby incorporated by reference.

FIG. 2A illustrates launching an application, such as an e-mailapplication, on a mobile telephone 164, by employing object detectionfunctionality of the type described hereinabove with reference to FIG.1C. As shown, a position of a user's finger is detected by means of atouch responsive input functionality operative in accordance with apreferred embodiment of the present invention.

As seen in FIG. 2A, a multiplicity of light detector elements 165 areinterspersed among light emitters 166 arranged in a plane 168. Examplesof such a structure are described in U.S. Pat. No. 7,034,866 and U.S.Patent Application Publication Nos. 2006/0132463A1, 2006/0007222A1 and2004/00012565A1, the disclosures of which are hereby incorporated byreference. Light, preferably including light in the IR band, reflectedby the user's finger, propagates through at least one cover layer 172and is detected by one or more of detector elements 165. The outputs ofdetector elements 165 are processed to indicate one or more of the X, Y,or Z positions and/or angular orientation of the user's finger. Thisdetected position is utilized, as taught inter alia in the aforesaidU.S. Provisional Patent Application No. 60/789,188, to launch anapplication or control any of the other functionalities described inU.S. Provisional Patent Application No. 60/789,188.

The source of the reflected light is preferably external to the mobiletelephone 164, for example as shown in FIG. 19. Suitable external lightsources include sunlight, artificial room lighting and IR illuminationemitted from a human body or other heat source. In an alternatepreferred embodiment, the source of the reflected light may comprise anillumination subassembly 174 which typically includes one or moreelectromagnetic radiation emitting sources, here shown as a multiple IRemitting LEDs 178. The illumination subassembly 174 preferably formspart of the integrated display and input device. Examples of varioussuitable configurations of illumination subassembly 174 are describedherein below in FIGS. 18A-18F. Optionally, the light emitted by LEDs 178may be modulated by modulating circuitry (not shown).

FIG. 2B shows an integrated display and input device having light beamimpingement responsive input functionality, which is useful forapplication selection and operation, such as email communication andinternet surfing. The input functionality may incorporate any one ormore features of assignee's U.S. Provisional Patent Application Nos.60/715,546; 60/734,027; 60/789,188 and 60/682,604, U.S. PatentApplication Publication No. 2005/0156914A1 and PCT Patent ApplicationPublication No. WO 2005/094176, the disclosures of which are herebyincorporated by reference.

FIG. 2B illustrates launching an application, such as an e-mailapplication, on a mobile telephone 182, by employing object detectionfunctionality of the type described hereinabove with reference to FIG.1CA position of a stylus 183 is detected by means of a light beamresponsive input functionality operative in accordance with a preferredembodiment of the present invention. As seen in FIG. 2B5 a multiplicityof light detector elements 184 are interspersed among light emitters 186arranged in a plane 188. Examples of such a structure are described inU.S. Pat. No. 7,034,866 and U.S. Patent Application Publication Nos.2006/0132463Al3 2006/0007222A1 and 2004/00012565A1, the disclosures ofwhich are hereby incorporated by reference. Light, preferably includinglight in the IR band, emitted by stylus 183, propagates through at leastone cover layer 190 and is detected by one or more of detector elements184. The outputs of detector elements 184 are processed to indicate oneor more of the X, Y or Z positions and/or angular orientation of thestylus 183. This detected position is utilized, as taught inter alia inthe aforesaid U.S. Provisional Patent Application No. 60/789,188, tolaunch an application or control any of the other functionalitiesdescribed in U.S. Provisional Patent Application No. 60/789,188.

Reference is now made to FIGS. 3A and 3B, which are simplifiedillustrations of portions of two types of integrated display and inputdevices constructed and operative in accordance with yet anotherpreferred embodiment of the present invention, employing elementsarranged in parallel planes, parallel to a viewing plane.

FIG. 3A shows an integrated display and input system having touchresponsive input functionality, which is useful for applicationselection and operation, such as email communication and internetsurfing. The input functionality may incorporate any one or morefeatures of assignee's U.S. Provisional Patent Application Nos.60/715,546; 60/734,027; 60/789,188 and 60/682,604, U.S. PatentApplication Publication No. 200510156914A1 and PCT Patent ApplicationPublication No. WO 2005/094176, the disclosures of which are herebyincorporated by reference. The touch responsive functionality preferablyemploys an integrated display and input system including an array 200 ofdetector elements 202 arranged in a plane, parallel to a viewing plane204. In accordance with a preferred embodiment of the present inventionthe array 200 is formed of a plurality of discrete detector elements 202placed on a plane integrally formed therewith. Alternatively, the array200 may be formed of one or more CCD or CMOS arrays, or may be createdby photolithography.

As seen in FIG. 3A, in one example of a display and input systemstructure, array 200 is arranged behind an IR transmissive display panel206, such as a panel including LCD or OLED elements, underlying aviewing plane defining plate 208. Viewing plane defining plate 208 maybe a single or multiple layer plate and may have one or more coatinglayers associated therewith. In one example of an integrated display andinput system employing an LCD, there are provided one or more lightdiffusing layers 210 overlying a reflector 212. One or more collimatinglayers 214 are typically interposed between reflector 212 and IRtransmissive display panel 206.

FIG. 3A illustrates launching an application, such as an e-mailapplication, on a mobile telephone 216, by employing object detectionfunctionality of the type described hereinabove with reference to FIG.1D. As shown, a position of a user's finger is detected by means of atouch responsive input functionality operative in accordance with apreferred embodiment of the present invention. Light, preferablyincluding light in the IR band, reflected by the user's finger,propagates through plate 208 and panel 206 and is detected by detectorelements 202. The outputs of detector elements 202 are processed toindicate one or more of the X, Y or Z positions and/or angularorientation of the user's finger. This detected position is utilized, astaught inter alia in the aforesaid U.S. Provisional Patent ApplicationNo. 60/789,188, to launch an application or control any of the otherfunctionalities described in U.S. Provisional Patent Application No.60/789,188.

The source of the reflected light is preferably external to the mobiletelephone 216, for example as shown in FIG. 19. Suitable external lightsources include sunlight, artificial room lighting and IR illuminationemitted from a human body or other heat source. In an alternatepreferred embodiment, the source of the reflected light may comprise anillumination subassembly 222 which typically includes one or moreelectromagnetic radiation emitting sources, here shown as multiple IRemitting LEDs 224. The illumination subassembly 222 preferably formspart of the integrated display and input device. Examples of varioussuitable configurations of illumination subassembly 222 are describedherein below in FIGS. 18A-18F. Optionally, the light emitted by LEDs 224may be modulated by modulating circuitry (not shown).

FIG. 3B shows an integrated display and input device having light beamimpingement responsive input functionality, which is useful forapplication selection and operation, such as email communication andinternet surfing. The input functionality may incorporate any one ormore features of assignee's U.S. Provisional Patent Application Nos.60/715,546; 60/734,027; 60/789,188 and 60/682,604, U.S. PatentApplication Publication No. 2005/0156914A1 and PCT Patent ApplicationPublication No. WO-2005/094176, the disclosures of which are herebyincorporated by reference. The light beam impingement responsivefunctionality preferably employs an integrated display and input systemincluding an array 250 of detector elements 252 arranged in a plane,parallel to a viewing plane 254. In accordance with a preferredembodiment of the present invention the array 250 is formed of aplurality of discrete detector elements 252 placed on a plane integrallyformed therewith. Alternatively, the array 250 may be formed of one ormore CCD or CMOS arrays, or may be created by photolithography.

As seen in FIG. 3B, array 250 is arranged behind an IR transmissivedisplay panel 256, such as a panel including LCD or OLED elements,underlying a viewing plane defining plate 258. Viewing plane definingplate 258 may be a single or multiple layer plate and may have one ormore coating layers associated therewith. In another example of anintegrated display and input device employing an LCD, interposed betweenarray 250 and IR transmissive display panel 256, there are provided oneor more light diffusing layers 260 overlying an IR transmissivereflector 262. One or more collimating layers 264 are typicallyinterposed between IR transmissive reflector 262 and IR transmissivedisplay panel 256.

FIG. 3B illustrates launching an application, such as an e-mailapplication on a mobile telephone 266, by employing object detectionfunctionality of the type described hereinabove with reference to FIG.1D. A position of a stylus 268 is detected by means of a light beamresponsive input functionality operative in accordance with a preferredembodiment of the present invention. Light, preferably including lightin the IR band, emitted by stylus 268, propagates through plate 258,panel 256, one or more of layers 264 and layers 260 and through IRtransmissive reflector 262, and is detected by one or more of detectorelements 252. The outputs of detector elements 252 are processed toindicate one or more of the X, Y or Z positions and/or angularorientation of the stylus 268. This detected position is utilized, astaught inter alia in the aforesaid U.S. Provisional Patent ApplicationNo. 60/789,188, to launch an application or control any of the otherfunctionalities described in U.S. Provisional Patent Application No.60/789,188.

Reference is now made to FIG. 4, which is a simplified illustration of aportion of an input device constructed and operative in accordance withstill another preferred embodiment of the present invention, employingdetector elements arranged along edges of a display element. In thestructure of FIG. 4, at least one detector assembly 300 is arrangedalong at least one edge 302 of a viewing plane defining plate 304 tosense light impinging on plate 304 and propagating within the plate 304to the edges 302 thereof. Viewing plane defining plate 304 may be asingle or multiple layer plate and may have one or more coating layersassociated therewith. Preferably, detector assemblies 300 are providedalong at least two mutually perpendicular edges 302, as shown, thoughdetector assemblies 300 may be provided along all or most of edges 302.Alternatively a single detector assembly 300 may be provided along onlyone edge 302 of plate 304. In accordance with a preferred embodiment ofthe present invention, the detector assembly 300 comprises a supportsubstrate 306 onto which is mounted a linear arrangement 308 of detectorelements 310. Interposed between linear arrangement 308 and edge 302 isa cover layer 312. Cover layer 312 may have multiple functions includingphysical protection, light intensity limitation, and field-of-viewlimitation and may have optical power. Cover layer 312 may be formed ofglass or any other suitable light transparent material, or of a suitablyapertured opaque material, such as metal.

The support substrate 306 may be mounted onto a display housing (notshown) or may be integrally formed therewith. The support substrate 306may alternatively be mounted onto an edge 302 of plate 304. The supportsubstrate 306 may be formed of a ceramic material, a material such asFR-4 which is commonly used for PCBs, glass, plastic or a metal such asaluminum. The support substrate 306 may also provide mounting for andelectrical connections to the detector elements 310. A processor 314 forprocessing the outputs of the detector elements 310 may also be mountedon the support substrate 306. It is a particular feature of thisembodiment of the present invention that the detector assembly 300 isextremely thin, preferably under 1 mm overall.

Accordingly, the support substrate 306 is preferably 50-200 microns inthickness, the linear arrangement 308 of detector elements 310 ispreferably 100-400 microns in thickness and the cover layer 312 ispreferably 100-500 microns in thickness.

The input device shown in FIG. 4 may also include a source of lightwhich is preferably external to the input device, for example as shownin FIG. 19. Suitable external light sources include sunlight, artificialroom lighting and IR illumination emitted from a human body or otherheat source. In an alternate preferred embodiment, the source of lightmay comprise an illumination subassembly 316 which typically includesone or more electromagnetic radiation emitting sources, here shown asmultiple IR emitting LEDs 318 mounted about diffusing and collimatinglayers 319 generally as shown in FIG. 18D. The illumination subassembly316 preferably forms part of the integrated display and input device.Examples of various suitable configurations of illumination subassembly316 are described herein below in FIGS. 18A-18F. Optionally, the lightemitted by LEDs 318 may be modulated by modulating circuitry (notshown). Reference is now made to FIG. 5, which is a simplifiedillustration of a portion of an input device constructed and operativein accordance with a further preferred embodiment of the presentinvention, employing detector elements arranged along edges of a displayelement. In the structure of FIG. 5, at least one detector assembly 320is arranged along at least one edge 322 of a viewing plane definingplate 324 to sense light impinging on plate 324 and propagating withinthe plate 324 to the edges 322 thereof. Viewing plane defining plate 324may be a single or multiple layer plate and may have one or more coatinglayers associated therewith. Preferably, detector assemblies 320 areprovided along at least two mutually perpendicular edges 322, as shown,though detector assemblies 320 may be provided along all or most ofedges 322. Alternatively a single detector assembly 320 may be providedalong only one edge 322 of plate 324.

In accordance with a preferred embodiment of the present invention, thedetector assembly 320 comprises a support substrate 326 onto which ismounted a linear arrangement 328 of detector elements 330. Interposedbetween linear arrangement 328 and edge 322 is a cover layer 332. In theillustrated embodiment, cover layer 332 is a field-of-view defining maskhaving apertures 333 formed therein, in sizes and arrangements whichprovide desired fields-of-view for the various corresponding detectorelements 330. Depending on the thickness of layer 332, each detectorelement 330 may have associated therewith a single aperture 333 or aplurality of smaller apertures, here designated by reference numeral334. The selection of aperture size and distribution is determined inpart by the mechanical strength of layer 332. Layer 332 may havemultiple functions including physical protection, field-of-viewlimitation and light intensity limitation, and may have optical power.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances position discrimination by limiting overlap betweenthe fields-of-view of adjacent detector elements 330. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 333 and their locations with respect to anddistances from detector elements 330. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 330 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 330 to a solidangle of less than or equal to 7 degrees.

The support substrate 326 may be mounted onto a display housing (notshown) or may be integrally formed therewith. The support substrate 326may alternatively be mounted onto an edge 322 of plate 324. The supportsubstrate 326 may be formed of a ceramic material, a material such asFR-4 which is commonly used for PCBs, glass, plastic or a metal such asaluminum. The support substrate 326 may also provide mounting for andelectrical connections to the detector elements 330. A processor 335 forprocessing the outputs of the detector elements 330 may also be mountedon the support substrate 326. The input device shown in FIG. 5 may alsoinclude a source of light which is preferably external to the inputdevice, for example as shown in FIG. 19. Suitable external light sourcesinclude sunlight, artificial room lighting and IR illumination emittedfrom a human body or other heat source. In an alternate preferredembodiment, the source of light may comprise an illumination subassembly336 which typically includes one or more electromagnetic radiationemitting sources, here shown as multiple IR emitting LEDs 338 mountedabout diffusing and collimating layers 339 generally as shown in FIG.18D. The illumination subassembly 336 preferably forms part of theintegrated display and input device. Examples of various suitableconfigurations of illumination subassembly 336 are described hereinbelow in FIGS. 18A-18F. Optionally, the light emitted by LED 338 may bemodulated by modulating circuitry (not shown). Reference is now made toFIG. 6, which is a simplified illustration of a portion of an inputdevice constructed and operative in accordance with a yet furtherpreferred embodiment of the present invention, employing detectorelements arranged along edges of a display element. In the structure ofFIG. 6, at least one detector assembly 340 is arranged along at leastone edge 342 of a viewing plane defining plate 344 to sense lightimpinging on plate 344 and propagating within the plate 344 to the edges342 thereof. Viewing plane defining plate 344 may be a single ormultiple layer plate and may have one or more coating layers associatedtherewith. Preferably, detector assemblies 340 are provided along atleast two mutually perpendicular edges 342, as shown, though detectorassemblies 340 may be provided along all or most of edges 342.Alternatively, a single detector assembly 340 may be provided along onlyone edge 342 of plate 344.

In accordance with a preferred embodiment of the present invention, thedetector assembly 340 comprises a support substrate 346 onto which ismounted a linear arrangement 348 of detector elements 350. Interposedbetween linear arrangement 348 and edge 342 is a cover layer 352.

The embodiment of FIG. 6 differs from that of FIG. 5 in that the coverlayer 352 is substantially thicker than cover layer 332 and ispreferably at least 200 microns in thickness. Layer 352 has apertures353 formed therein, which apertures 353 define light collimatingtunnels. Apertures 353 are formed in layer 352, in sizes andarrangements which provide desired fields-of-view for the variouscorresponding detector elements 350. Depending on the thickness of layer352, each detector element 350 may have associated therewith a singletunnel-defining aperture 353 as shown or a plurality of smallertunnel-defining apertures. The selection of aperture size anddistribution is determined in part by the mechanical strength of layer352. Layer 352 may have multiple functions including physicalprotection, field-of-view limitation and light intensity limitation, andmay have optical power.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances position discrimination by limiting overlap betweenthe fields-of-view of adjacent detector elements 350. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 353 and their locations with respect to anddistances from detector elements 350. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 350 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 350 to a solidangle of less than or equal to 7 degrees.

The support substrate 346 may be mounted onto a display housing (notshown) or may be integrally formed therewith. The support substrate 346may alternatively be mounted onto an edge 342 of plate 344. The supportsubstrate 346 may be formed of a ceramic material, a material such asFR-4 which is commonly used for PCBs, glass, plastic or a metal such asaluminum. The support substrate 346 may also provide mounting for andelectrical connections to the detector elements 350. A processor 354 forprocessing the outputs of the detector elements 350 may also be mountedon the support substrate 346.

The input device shown in FIG. 6 may also include a source of lightwhich is preferably external to the input device, for example as shownin FIG. 19. Suitable external light sources include sunlight, artificialroom lighting and IR illumination emitted from a human body or otherheat source. In an alternate preferred embodiment, the source of lightmay comprise an illumination subassembly 356 which typically includesone or more electromagnetic radiation emitting sources, here shown asmultiple IR emitting LEDs 358. The illumination subassembly 356preferably forms part of the integrated display and input device.Examples of various suitable configurations of illumination subassembly356 are described herein below in FIGS. 18A-18F. Optionally, the lightemitted by LEDs 358 may be modulated by modulating circuitry (notshown). LEDs 358 are preferably configured and positioned so as toprovide a relatively wide angular range of illumination but withoutshining directly onto detector elements 350.

Reference is now made to FIG. 7, which is a simplified illustration of aportion of an input device constructed and operative in accordance withan additional preferred-embodiment of the present invention, employingdetector elements arranged along edges of a display element. In thestructure of FIG. 7, at least one detector assembly 360 is arrangedalong at least one edge 362 of a viewing plane defining plate 364 tosense light impinging on plate 364 and propagating within the plate 364to the edges 362 thereof. Viewing plane defining plate 364 may be asingle or multiple layer plate and may have one or more coating layersassociated therewith. Preferably, detector assemblies 360 are providedalong at least two mutually perpendicular edges 362, as shown, thoughdetector assemblies 360 may be provided along all or most of edges 362.Alternatively, a single detector assembly 360 may be provided along onlyone edge 362 of plate 364.

In accordance with a preferred embodiment of the present invention, thedetector assembly 360 comprises a support substrate 366 onto which ismounted a linear arrangement 368 of detector elements 370. Interposedbetween linear arrangement 368 and edge 362 is a cover layer 372.

The embodiment of FIG. 7 differs from that of FIGS. 5 and 6 in thatapertures in the cover layer in FIGS. 5 and 6 are replaced by lenses 373formed in cover layer 372. Lenses 373 may be integrally formed withlayer 372 or may be discrete elements fitted within suitably sized andpositioned apertures in an opaque substrate. Lenses 373 may beassociated with tunnel-defining apertures or may comprise an array ofmicrolenses aligned with one or more of detector elements 370.

Layer 372 may have multiple functions including physical protection,field-of-view limitation and light intensity limitation, and may haveoptical power. Field-of-view limiting functionality may be desirable inthis context because it enhances position discrimination by limitingoverlap between the fields-of-view of adjacent detector elements 370.

The support substrate 366 may be mounted onto a display housing (notshown) or may be integrally formed therewith. The support substrate 366may alternatively be mounted onto an edge 362 of plate 364. The supportsubstrate 366 may be formed of a ceramic material, a material such asFR-4 which is commonly used for PCBs5 glass, plastic or a metal such asaluminum. The support substrate may also provide mounting for andelectrical connections to the detector elements 370. A processor 374 forprocessing the outputs of the detector elements 370 may also be mountedon the support substrate 366.

The input device shown in FIG. 7 may also include a source of lightwhich is preferably external to the input device, for example as shownin FIG. 19. Suitable external light sources include sunlight, artificialroom lighting and IR illumination emitted from a human body or otherheat source. In an alternate preferred embodiment, the source of lightmay comprise an illumination subassembly 376 which typically includesone or more electromagnetic radiation emitting sources, here shown asmultiple IR emitting LEDs 378. The illumination subassembly 376preferably forms part of the integrated display and input device.Examples of various suitable configurations of illumination subassembly376 are described herein below in FIGS. 18A-18F. Optionally, the lightemitted by LEDs 378 may be modulated by modulating circuitry (notshown). Reference is now made to FIGS. 8A-8D, which are simplifiedillustrations of four alternative embodiments of a portion of an inputdevice constructed and operative in accordance with another preferredembodiment of the present invention, employing detector elementsarranged along edges of a display element.

In the structure of FIGS. 8A-8D, at least one detector assembly 400 isarranged along at least one edge 402 of a viewing plane defining plate404 to sense light impinging on plate 404 and propagating within theplate 404 to the edges 402 thereof. Viewing plane defining plate 404 maybe a single or multiple layer plate and may have one or more coatinglayers associated therewith. Preferably, detector assemblies 400 areprovided along at least two mutually perpendicular edges 402, thoughdetector assemblies 400 may be provided along all or most of edges 402.Alternatively, a single detector assembly 400 may be provided along onlyone edge 402 of plate 404.

In accordance with a preferred embodiment of the present invention, thedetector assembly 400 comprises a support substrate 406 onto which ismounted a linear arrangement 408 of detector elements 410. As distinctfrom the embodiments of FIGS. 4-7, in the embodiments of FIGS. 8A-8D,the cover layer is obviated and its functionality is provided bysuitable conditioning of edge 402 of viewing plane defining plate 404.This functionality may provide multiple functions including physicalprotection, light intensity limitation and field-of-view limitation, andmay have optical power.

The support substrate 406 may be mounted onto a display-housing (notshown) or may be integrally formed therewith. The support substrate 406may alternatively be mounted onto an edge 402 of plate 404. The supportsubstrate 406 may be formed of a ceramic material, a material such asFR-4 which is commonly used for PCBs, glass, plastic or a metal such asaluminum. The support substrate may also provide mounting for andelectrical connections to the detector elements 410. A processor 414 forprocessing the outputs of the detector elements 410 may also be mountedon the support substrate 406.

It is a particular feature of this embodiment of the present inventionthat the detector assembly 400 is extremely thin, preferably under 1 mmoverall. Accordingly, the support substrate 406 is preferably 50-200microns in thickness and the linear arrangement 408 of detector elements410 is preferably 100-400 microns in thickness.

The input devices shown in FIG. 8A-8D may also include a source of lightwhich is preferably external to the input device, for example as shownin FIG. 19. Suitable external light sources include sunlight, artificialroom lighting and IR illumination emitted from a human body or otherheat source. In an alternate preferred embodiment, the source of lightmay comprise an illumination subassembly 416 which typically includesone or more electromagnetic radiation emitting sources, here shown asmultiple IR emitting LEDs 418. The illumination subassembly 416preferably forms part of the integrated display and input device.Examples of various suitable configurations of illumination subassembly416 are described herein below in FIGS. 18A-18F. Optionally, the lightemitted by LEDs 418 may be modulated by modulating circuitry (notshown).

In the embodiment of FIG. 8A, edge 402 is uniformly polished forunimpeded light transmission therethrough to linear arrangement 408 ofdetector elements 410. Reference is now made to FIG. 8B5 in which it isseen that edge 402 is conditioned to define a field-of-view definingmask 420 having apertures 433 formed therein in sizes and arrangementswhich provide desired fields-of-view for the various correspondingdetector elements 410. Each detector element 410 may have associatedtherewith a single aperture 433, as shown, or a plurality of smallerapertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 410. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 433 and their locations with respect to anddistances from detector elements 410. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 410 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 410 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 8 C, which differs from that of FIG. 8B inthat apertures 433 in mask 420 are replaced by light collimatingtunnel-defining apertures 440 in a mask 442.

Each detector element 410 may have associated therewith a singletunnel-defining aperture 440 as shown or a plurality of smallertunnel-defining apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 410. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 440 and their locations with respect to anddistances from detector elements 410. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 410 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 410 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 8D, which differs from that of FIGS. 8Band 8C in that the apertures in FIGS. 8B and 8C are replaced by lenses453. Lenses 453 may be integrally formed at edges 402 or may be discreteelements fitted within suitably sized and positioned apertures in plate404. Lenses 453 may be associated with tunnel-defining apertures or maycomprise an array of microlenses aligned with one or more of detectorelements 410.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 410. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of lenses 453 and their locations with respect to anddistances from detector elements 410. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 410 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 410 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIGS. 9A, 9B, 9C and 9D, which are simplifiedillustrations of four alternative embodiments of a portion of an inputdevice constructed and operative in accordance with yet anotherpreferred embodiment of the present invention, employing forward-facingdetector elements arranged about edges of a display element.

In the structure of FIGS. 9A-9D, at least one detector assembly 500 isarranged about at least one edge 502 of a viewing plane defining plate504 to sense light impinging directly onto detector assembly 500.Viewing plane defining plate 504 may be a single or multiple layer plateand may have one or more coating layers associated therewith. Light,preferably including light in the IR band, is emitted by a light beamemitter such as light beam emitter 128 in the embodiment of FIG. 1B or alight reflecting object as in the embodiment of FIG. 1A. Preferably,detector assemblies 500 are provided along at least two mutuallyperpendicular edges 502, though detector assemblies 500 may be providedalong all or most of edges 502. Alternatively, a single detectorassembly 500 may be provided along only one edge 502 of plate 504.

In accordance with a preferred embodiment of the present invention, thedetector assembly 500 comprises a support substrate 506 onto which ismounted a linear arrangement 508 of detector elements 510. As distinctfrom the embodiments of FIGS. 8A-8D, there is provided a cover layer 512and as distinct from the embodiments of FIGS. 4-7, the detector assembly500 and the detector elements 510 are generally forward facing, in thesense illustrated generally in FIG. 1B and described hereinabove withrespect thereto. The cover layer 512 may provide multiple functionsincluding physical protection, light intensity limitation andfield-of-view limitation, and may have optical power. The supportsubstrate 506 may be mounted onto a display housing (not shown) or maybe integrally formed therewith. The support substrate 506 mayalternatively be mounted onto an edge 502 of plate 504. The supportsubstrate 506 may be formed of a ceramic material, a material such asFR-4 which is commonly used for PCBs, glass, plastic or a metal such asaluminum. The support substrate may also provide mounting for andelectrical connections to the detector elements 510. A processor 514′for processing the outputs of the detector elements 510 may also bemounted on the support substrate 506.

It is a particular feature of this embodiment of the present inventionthat the detector assembly 500 is extremely thin, preferably under 1 mmoverall. Accordingly, the support substrate 506 is preferably 50-200microns in thickness and the linear arrangement 508 of detector elements510 is preferably 100-400 microns in thickness and the cover layer 512is preferably 100-500 microns in thickness.

The input devices shown in FIG. 9A-9D may also include a source of lightwhich is preferably external to the input device, for example as shownin FIG. 19. Suitable external light sources include sunlight, artificialroom lighting and IR illumination emitted from a human body or otherheat source. In an alternate preferred embodiment, the source of lightmay comprise an illumination subassembly 516 which typically includesone or more electromagnetic radiation emitting sources, here shown asmultiple IR emitting LEDs 518. The illumination subassembly 516preferably forms part of the integrated display and input device.Examples of various suitable configurations of illumination subassembly516 are described herein below in FIGS. 18A-18F. Optionally, the lightemitted by LEDs 518 may be modulated by modulating circuitry (notshown).

In the embodiment of FIG. 9A, cover layer 512 is formed of glass or anyother suitable light transparent material.

Reference is now made to FIG. 9B, in which it is seen that cover layer512 includes a field-of-view defining mask 520 having apertures 533formed therein in sizes and arrangements which provide desiredfields-of-view for the various corresponding detector elements 510. Eachdetector element 510 may have associated therewith a single aperture533, as shown, or a plurality of smaller apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 510. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 533 and their locations with respect to anddistances from detector elements 510. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 510 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 510 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 9C, which differs from that of FIG. 9B inthat apertures 533 in mask 520 are replaced by light collimatingtunnel-defining apertures 540 in a mask 542.

Each detector element 510 may have associated therewith a singletunnel-defining aperture 540 as shown or a plurality of smallertunnel-defining apertures. Field-of-view limiting functionality may bedesirable in this context because it enhances resolution by limitingoverlap between the fields-of-view of adjacent detector elements 510.Extent of field-of-view limiting may be controlled by the size, pitchand arrangement of apertures 540 and their locations with respect to anddistances from detector elements 510. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 510 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 510 to a solidangle of less than or equal to 7 degrees. Reference is now made to FIG.9D, which differs from that of FIGS. 9B and 9G in that the apertures inFIGS. 9B and 9C are replaced by lenses 553. Lenses 553 may be integrallyformed with cover layer 512 or may be discrete elements fitted withinsuitably sized and positioned apertures in cover layer 512. Lenses 553may be associated with tunnel-defining aperture's or may comprise anarray of microlenses aligned with one or more of detector elements 510.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 510. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of lenses 553 and their locations with respect to anddistances from detector elements 510. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 510 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 510 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIGS. 10A, 10B, 10C and 10D, which aresimplified illustrations of four alternative embodiments of a portion ofan input device constructed and operative in accordance with stillanother preferred embodiment of the present invention, employingforward-facing detector elements arranged behind edges of a displayelement.

In the structure of FIGS. 10A-10D, at least one detector assembly 600 isarranged behind at least one edge 602 of a viewing plane defining plate604 to sense light impinging onto detector assembly 600 afterpropagating through plate 604. Viewing plane defining plate 604 may be asingle or multiple layer plate and may have one or more coating layersassociated therewith. The light, preferably including light in the IRband, is emitted by a light beam emitter such as light beam emitter 128in the embodiment of FIG. 1B or a light reflecting object as in theembodiment of FIG. 1A. Preferably, detector assemblies 600 are providedbehind at least two mutually perpendicular edges 602, though detectorassemblies 600 may be provided behind all or most of edges 602.Alternatively, a single detector assembly 600 may be provided behindonly one of edges 602. In accordance with a preferred embodiment of thepresent invention, the detector assembly 600 comprises a supportsubstrate 606 onto which is mounted a linear arrangement 608 of detectorelements 610. Similarly to the embodiments of FIGS. 9A-9D, there isprovided a cover layer 612 and as distinct from the embodiments of FIGS.4-7, the detector assembly 600 and the detector elements 610 aregenerally forward facing, in the sense illustrated generally in FIG. 1Band described hereinabove with respect thereto. The cover layer 612 mayprovide multiple functions including physical protection, lightintensity limitation and field-of-view limitation, and may have opticalpower.

The support substrate 606 may be mounted onto a display housing (notshown) or may be integrally formed therewith. The support substrate 606may alternatively be mounted onto a rearward facing surface 613 of plate604 at the edge 602 lying in front of the linear arrangement 608. Thesupport substrate 606 may be formed of a ceramic material, a materialsuch as FR-4 which is commonly used for PCBs, glass, plastic or a metalsuch as aluminum. The support substrate 606 may also provide mountingfor and electrical connections to the detector elements 610. A processor614 for processing the outputs of the detector elements 610 may also bemounted on the support substrate 606.

It is a particular feature of this embodiment of the present inventionthat the detector assembly 600 is extremely thin, preferably under 1 mmoverall. Accordingly, the support substrate 606 is preferably 50-200microns in thickness and the linear arrangement 608 of detector elements610 is preferably 100-400 microns in thickness and the cover layer 612is preferably 100-500 microns in thickness.

The input devices shown in FIG. 10A-10D may also include a source oflight which is preferably external to the input device, for example asshown in FIG. 19. Suitable external light sources include sunlight,artificial room lighting and IR illumination emitted from a human bodyor other heat source. In an alternate preferred embodiment, the sourceof light may comprise an illumination subassembly 616 which typicallyincludes one or more electromagnetic radiation emitting sources, hereshown as multiple IR emitting LEDs 618. The illumination subassembly 616preferably forms part of the integrated display and input device.Examples of various suitable configurations of illumination subassembly616 are described herein below in FIGS. 18A-18F. Optionally, the lightemitted by LEDs 618 may be modulated by modulating circuitry (notshown).

In the embodiment of FIG. 10A, cover layer 612 is formed of glass or anyother suitable light transparent material.

Reference is now made to FIG. 10B, in which it is seen that cover layer612 includes a field-of-view defining mask 620 having apertures 633formed therein in sizes and arrangements which provide desiredfields-of-view for the various corresponding detector elements 610. Eachdetector element 610 may have associated therewith a single aperture 633as shown or a plurality of smaller apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 610. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 633 and their locations with respect to anddistances from detector elements 610. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 610 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 610 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 10C, which differs from that of FIG. 10Bin that apertures 633 in mask 620 are replaced by light collimatingtunnel-defining apertures 640 in a mask 642.

Each detector element 610 may have associated therewith a singletunnel-defining aperture 640 as shown or a plurality of smallertunnel-defining apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 610. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 640 and their locations with respect to anddistances from detector elements 610. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 610 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 610 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 10D, which differs from that of FIGS. 10Band 10C in that the apertures in FIGS. 10B and 10C are replaced bylenses 653. Lenses 5 653 may be integrally formed with cover layer 612or may be discrete elements fitted within suitably sized and positionedapertures in cover layer 612. Lenses 653 may be associated withtunnel-defining apertures or may comprise an array of microlensesaligned with one or more of detector elements 610.

Field-of-view limiting functionality may be desirable in this context 10because it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 610. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of lenses 653 and their locations with respect to anddistances from detector elements 610. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector 15 elements 610 to a solidangle of less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 610 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIGS. 11A, 11B, 11C and 11D which are 20simplified illustrations of four alternative embodiments of a portion ofan input device constructed and operative in accordance with a furtherpreferred embodiment of the present invention, employing forward-facingdetector elements arranged behind edges of a display element.

In the structure of FIGS. 11A-11D, at least one detector assembly 700 is25 arranged behind at least one edge 702 of a viewing plane definingplate 704 to sense light impinging onto detector assembly 700 afterpropagating through plate 704. Viewing plane defining plate 704 may be asingle or multiple layer plate and may have one or more coating layersassociated therewith. The light, preferably including light in the IRband, is emitted by a light beam emitter such as light beam emitter 128in the 30 embodiment of FIG. 1B or a light reflecting object as in theembodiment of FIG. 1A.

Preferably, detector assemblies 700 are provided behind at least twomutually perpendicular edges 702, though detector assemblies 700 may beprovided behind all or most of edges 702. Alternatively, a singledetector assembly 700 may be provided behind plate 704 at only one edgethereof.

In accordance with a preferred embodiment of the present invention, thedetector assembly 700 comprises a support substrate 706 onto which ismounted a linear 5 arrangement 708 of detector elements 710. As distinctfrom the embodiments of FIGS. 4-7, in the embodiments of FIGS. 11A-11D,the detector assembly 700 and the detector elements 710 are generallyforward facing, in the sense illustrated generally in FIG. 1B anddescribed hereinabove with respect thereto. Also, as distinct from theembodiments of FIGS. 10A-10D, the cover layer is obviated and itsfunctionality is provided by 10 suitable conditioning of a rearwardfacing surface 711 of plate 704 at the edge 702 lying in front of thelinear arrangement 708. This functionality may provide multiplefunctions including physical protection, light intensity limitation andfield-of-view limitation, and may have optical power.

The support substrate 706 may be mounted onto a display housing (not 15shown) or may be integrally formed therewith. The support substrate 706may alternatively be mounted onto the rearward facing surface 711 ofplate 704 at the edge 702. The support substrate 706 may be formed of aceramic material, a material such as FR-4 which is commonly used forPCBs, glass, plastic or a metal such as aluminum.

The support substrate may also provide mounting for and electricalconnections to the 20 detector elements 710. A processor 714 forprocessing the outputs of the detector elements 710 may also be mountedon the support substrate 706.

It is a particular feature of this embodiment of the present inventionthat the detector assembly 700 is extremely thin, preferably under 1 mmoverall.

Accordingly, the support substrate 706 is preferably 50-200 microns inthickness and 25 the linear arrangement 708 of detector elements 710 ispreferably 100-400 microns in thickness.

The input devices shown in FIG. 11A-11D may also include a source oflight which is preferably external to the input device, for example asshown in FIG. 19.

Suitable external light sources include sunlight, artificial roomlighting and IR 30 illumination emitted from a human body or other heatsource. In an alternate preferred embodiment, the source of light maycomprise an illumination subassembly 716 which typically includes one ormore electromagnetic radiation emitting sources, here shown as multipleIR emitting LEDs 718. The illumination subassembly 716 preferably formspart of the integrated display and input device. Examples of varioussuitable configurations of illumination subassembly 716 are describedherein below in FIGS. 18A-18F. Optionally, the light emitted by LEDs 718may be modulated by modulating circuitry (not shown).

In the embodiment of FIG. 11A, the rearward facing surface 711 of plate704 at the edge 702 lying in front of the linear arrangement 708 isuniformly polished for unimpeded light transmission therethrough tolinear arrangement 708 of detector elements 710. Reference is now madeto FIG. 11B, in which it is seen that the rearward facing surface 711 ofplate 704 at the edge 702 lying in front of the linear arrangement 708is conditioned to define a field-of-view defining mask 720 havingapertures 733 formed therein in sizes and arrangements which providedesired fields-of-view for the various corresponding detector elements710. Each detector element 710 may have associated therewith a singleaperture 733 as shown or a plurality of smaller apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 710. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 733 and their locations with respect to anddistances from detector elements 710. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 710 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 710 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 11C, which differs from that of FIG. 11Bin that apertures 733 in mask 720 are replaced by light collimatingtunnel-defining apertures 740 in a mask 742.

Each detector element 710 may have associated therewith a singletunnel-defining aperture 740 as shown or a plurality of smallertunnel-defining apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 710. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 740 and their locations with respect to anddistances from detector elements 710. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 710 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 710 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 11D, which differs from that of FIGS. 11Band 11C in that the apertures in FIGS. 11B and 11C are replaced bylenses 753. Lenses 753 may be integrally formed at edges 702 or may bediscrete elements fitted within suitably sized and positioned aperturesin plate 704. Lenses 753 may be associated with tunnel-definingapertures or may comprise an array of microlenses aligned with one ormore of detector elements 710.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 710. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of lenses 753 and their locations with respect to anddistances from detector elements 710. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 710 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 710 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIGS. 12A, 12B, 12C and 12D, which aresimplified illustrations of four alternative embodiments of a portion ofan input device constructed and operative in accordance with a yetfurther preferred embodiment of the present invention, employingdetector elements arranged along edges of a display element.

In the structure of FIGS. 12A-12D, at least one detector assembly 800 isarranged along at least one edge 802 of a viewing plane defining plate804 to sense light impinging on plate 804 and propagating within theplate to the edges 802 thereof. Viewing plane defining plate 804 may bea single or multiple layer plate and may have one or more coating layersassociated therewith. Preferably, detector assemblies 800 are providedalong at least two mutually perpendicular edges 802, though detectorassemblies 800 may be provided along all or most of edges 802.Alternatively, a single detector assembly 800 may be provided along onlyone edge 802 of plate 804.

The detector assembly 800 includes a linear arrangement 808 of detectorelements 810. As distinct from the embodiments of FIGS. 8A-8D, thedetector assembly 800 does not comprise a support substrate onto whichis mounted a linear arrangement of detector elements. In the embodimentsof FIGS. 12A-12D, the support substrate of FIGS. 8A-8D is replaced by aportion of a peripheral housing 812. Similarly to the embodiments ofFIGS. 4-7 there is provided a cover layer 814 which provides multiplefunctions including physical protection, light intensity limitation andfield-of-view limitation, and may have optical power.

The peripheral housing 812 may be formed of any suitable materialincluding, for example, ceramic material, a material such as FR-4 whichis commonly used for PCBs, glass, plastic or a metal such as aluminum.The peripheral housing 812 may also provide mounting for and electricalconnections to the detector elements 810. A processor 816 for processingthe outputs of the detector elements 810 may also be mounted on theperipheral housing 812.

It is a particular feature of this embodiment of the present inventionthat the detector assembly 800 is extremely thin, preferably under 1 mmoverall. Accordingly, the linear arrangement 808 of detector elements810 is preferably 100-400 microns in thickness.

The input devices shown in FIG. 12A-12D may also include a source oflight which is preferably external to the input device, for example asshown in FIG. 19. Suitable external light sources include sunlight,artificial room lighting and IR illumination emitted from a human bodyor other heat source. In an alternate preferred embodiment, the sourceof light may comprise an illumination subassembly 817 which typicallyincludes one or more electromagnetic radiation emitting sources, hereshown as multiple IR emitting LEDs 818. The illumination subassembly 817preferably forms part of the integrated display and input device.Examples of various suitable configurations of illumination subassembly817 are described herein below in FIGS. 18A-18F. Optionally, the lightemitted by LEDs 818 may be modulated by modulating circuitry (notshown).

In the embodiment of FIG. 12A, cover layer 814 provides generallyunimpeded light transmission therethrough to linear arrangement 808 ofdetector elements 810.

Reference is now made to FIG. 12B, in which it is seen that cover layer814 defines a field-of-view defining mask 820 having apertures 833formed therein in sizes and arrangements which provide desiredfields-of-view for the various corresponding detector elements 810. Eachdetector element 810 may have associated therewith a single aperture 833as shown or a plurality of smaller apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 810. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 833 and their locations with respect to anddistances from detector elements 810. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 810 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 810 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 12C, which differs from that of FIG. 12Bin that apertures 833 in mask 820 are replaced by light collimatingtunnel-defining apertures 840 in a mask 842.

Each detector element 810 may have associated therewith a singletunnel-defining aperture 840 as shown or a plurality of smallertunnel-defining apertures. Field-of-view limiting functionality may bedesirable in this context because it enhances resolution by limitingoverlap between the fields-of-view of adjacent detector elements 810.Extent of field-of-view limiting may be controlled by the size, pitchand arrangement of apertures 840 and their locations with respect to anddistances from detector elements 810. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 810 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 810 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 12D, which differs from that of FIGS. 12Band 12C in that the apertures in FIGS. 12B and 12C are replaced bylenses 853. Lenses 853 may be integrally formed at edges 802 or may bediscrete elements fitted within suitably sized and positioned aperturesin plate 804. Lenses 853 may be associated with tunnel-definingapertures or may comprise an array of microlenses aligned with one ormore of detector elements 810.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 810. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of lenses 853 and their locations with respect to anddistances from detector elements 810. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 810 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 810 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIGS. 13A, 13B, 13C and 13D, which aresimplified illustrations of four alternative embodiments of a portion ofan input device constructed and operative in accordance with a stillfurther preferred embodiment of the present invention, employingdetector elements arranged along edges of a display element.

In the structure of FIGS. 13A-13D, at least one detector assembly 860 isarranged along at least one edge 862 of a viewing plane defining plate864 to sense light impinging on plate 864 and propagating within theplate 864 to the edges 862 thereof. Viewing plane defining plate 864 maybe a single or multiple layer plate and may have one or more coatinglayers associated therewith. Preferably, detector assemblies 860 areprovided along at least two mutually perpendicular edges 862, thoughdetector assemblies 860 may be provided along all or most of edges 862.Alternatively, a single detector assembly 860 may be provided along onlyone edge 862 of plate 864. The detector assembly 860 includes a lineararrangement 868 of detector elements 870. As distinct from theembodiments of FIGS. 12A-12D, in the embodiments of FIGS. 13A-13D, thecover layer is obviated and its functionality is provided by suitableconditioning of edge 862 of viewing plane defining plate 864. Thisfunctionality may provide multiple functions including physicalprotection, light intensity limitation and field-of-view limitation, andmay have optical power.

As in the embodiment of FIGS. 13A-13D, detector assembly 860 does notcomprise a support substrate onto which is mounted a linear arrangementof detector elements. In the embodiments of FIGS. 13A-13D, the supportsubstrate of FIGS. 8A-8D is replaced by a portion of a peripheralhousing 872. The peripheral housing 872 may be formed of any suitablematerial including, for example, ceramic material, a material such asFR-4 which is commonly used for PCBs, glass, plastic or a metal such asaluminum. The peripheral housing 872 may also provide mounting for andelectrical connections to the detector elements 870. A processor 876 forprocessing the outputs of the detector elements 870 may also be mountedon the peripheral housing 872.

It is a particular feature of this embodiment of the present inventionthat the detector assembly 860 is extremely thin, preferably under 1 mmoverall. Accordingly, the linear arrangement 868 of detector elements870 is preferably 100-400 microns in thickness. The input devices shownin FIG. 13A-13D may also include a source of light which is preferablyexternal to the input device, for example as shown in FIG. 19. Suitableexternal light sources include sunlight, artificial room lighting and IRillumination emitted from a human body or other heat source. In analternate preferred embodiment, the source of light may comprise anillumination subassembly 877 which typically includes one or moreelectromagnetic radiation emitting sources, here shown as multiple IRemitting LEDs 878. The illumination subassembly 877 preferably formspart of the integrated display and input device. Examples of varioussuitable configurations of illumination subassembly 877 are describedherein below in FIGS. 18A-18F. Optionally, the light emitted by LEDs 878may be modulated by modulating circuitry (not shown).

In the embodiment of FIG. 13A, edge 862 is uniformly polished forunimpeded light transmission therethrough to linear arrangement 868 ofdetector elements 870.

Reference is now made to FIG. 13B, in which it is seen that edge 862 isconditioned to define a field-of-view defining mask 880 having apertures883 formed therein in sizes and arrangements which provide desiredfields-of-view for the various corresponding detector elements 870. Eachdetector element 870 may have associated therewith a single aperture 883as shown or a plurality of smaller apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 870. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 883 and their locations with respect to anddistances from detector elements 870. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 870 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 870 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 13 C, which differs from that of FIG. 13Bin that apertures 883 in mask 880 are replaced by light collimatingtunnel-defining apertures 890 in a mask 892. Each detector element 870may have associated therewith a single tunnel-defining aperture 890 asshown or a plurality of smaller tunnel-defining apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 870. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 890 and their locations with respect to anddistances from detector elements 870. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 870 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 870 to a solidangle of less than or equal to 7 degrees,

Reference is now made to FIG. 13D, which differs from FIGS. 13B and 13Cin that the apertures in FIGS. 13B and 13C are replaced by lenses 893.Lenses 893 may be integrally formed at edges 862 or may be discreteelements fitted within suitably sized and positioned apertures in plate864. Lenses 893 may be associated with tunnel-defining apertures or maycomprise an array of microlenses aligned with one or more of detectorelements 870.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 870. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of lenses 893 and their locations with respect to anddistances from detector elements 870. In accordance with a preferredembodiment; the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 870 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 870 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIGS. 14A, 14B, 14C and 14D, which aresimplified illustrations of four alternative embodiments of a portion ofan input device constructed and operative in accordance with anadditional preferred embodiment of the present invention, employingforward-facing detector elements arranged about edges of a displayelement.

In the structure of FIGS. 14A-14D, at least one detector assembly 900 isarranged about at least one edge 902 of a viewing plane defining plate904 to sense light impinging directly onto detector assembly 900.Viewing plane defining plate 904 may be a single or multiple layer plateand may have one or more coating layers associated therewith. The light,preferably including light in the IR band, is emitted by a light beamemitter such as light beam emitter 128 in the embodiment of FIG. 1B or alight reflecting object as in the embodiment of FIG. 1A. Preferably,detector assemblies 900 are provided along at least two mutuallyperpendicular edges 902, though detector assemblies 900 may be providedalong all or most of edges 902. Alternatively, a single detectorassembly 900 may be provided along only one edge 902 of plate 904. Thedetector assembly 900 includes a linear arrangement 908 of detectorelements 910. As distinct from the embodiments of FIGS. 9A-9D, thedetector assembly 900 does not comprise a support substrate onto whichis mounted a linear arrangement of detector elements. In the embodimentsof FIGS. 14A-14D, the support substrate of FIGS. 9A-9D is replaced by aportion of a peripheral housing 912. Similarly to the embodiments ofFIGS. 9A-9D there is provided a cover layer 914 which provides multiplefunctions including physical protection, light intensity limitation andfield-of-view limitation, and may have optical power.

The peripheral housing 912 may be formed of any suitable materialincluding, for example, ceramic material, a material such as FR-4 whichis commonly used for PCBs, glass, plastic or a metal such as aluminum.The peripheral housing 912 may also provide mounting for and electricalconnections to the detector elements 910. A processor 916 for processingthe outputs of the detector elements 910 may also be mounted on theperipheral housing 912.

It is a particular feature of this embodiment of the present inventionthat the detector assembly 900 is extremely thin, preferably under 1 mmoverall. Accordingly, the linear arrangement 908 of detector elements910 is preferably 100-400 microns in thickness and the cover layer 914is preferably 100-500 microns in thickness.

The input devices shown in FIG. 14A-14D may also include a source oflight which is preferably external to the input device, for example asshown in FIG. 19. Suitable external light sources include sunlight,artificial room lighting and IR illumination emitted from a human bodyor other heat source. In an alternate preferred embodiment, the sourceof light may comprise an illumination subassembly 917 which typicallyincludes one or more electromagnetic radiation emitting sources, hereshown as multiple IR emitting LEDs 918. The illumination subassembly 917preferably forms part of the integrated display and input device.Examples of various suitable configurations of illumination subassembly917 are described herein below in FIGS. 18A-18F. Optionally, the lightemitted by LEDs 918 may be modulated by modulating circuitry (notshown).

In the embodiment of FIG. 14A, cover layer 914 is formed of glass or anyother suitable light transparent material. Reference is now made to FIG.14B, in which it is seen that cover layer 914 includes a field-of-viewdefining mask 920 having apertures 933 formed therein in sizes andarrangements which provide desired fields-of-view for the variouscorresponding detector elements 910. Each detector element 910 may haveassociated therewith a single aperture 933 as shown or a plurality ofsmaller apertures. Field-of-view limiting functionality may be desirablein this context because it enhances resolution by limiting overlapbetween the fields-of-view of adjacent detector elements 910. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 933 and their locations with respect to anddistances from detector elements 910. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 910 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 910 to a solidangle of less than or equal to 7 degrees. Reference is now made to FIG.14C, which differs from that of FIG. 14B in that apertures 933 in mask920 are replaced by light collimating tunnel-defining apertures 940 in amask 942.

Each detector element 910 may have associated therewith a singletunnel-defining aperture 940 as shown or a plurality of smallertunnel-defining apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 910. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 940 and their locations with respect to anddistances from detector elements 910. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 910 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 910 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 14D, which differs from that of FIGS. 14Band 14C in that the apertures in FIGS. 14B and 14C are replaced bylenses 953. Lenses 953 may be integrally formed with cover layer 914 ormay be discrete elements fitted within suitably sized and positionedapertures in cover layer 914. Lenses 953 may be associated withtunnel-defining apertures or may comprise an array of microlensesaligned with one or more of detector elements 910. Field-of-viewlimiting functionality may be desirable in this context because itenhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements 910. Extent of field-of-view limiting may becontrolled by the size, pitch and arrangement of lenses 953 and theirlocations with respect to and distances from detector elements 910. Inaccordance with a preferred embodiment, the field-of-view limitingfunctionality limits the field-of-view of at least one of detectorelements 910 to a solid angle of less than or equal to 15 degrees. Inaccordance with another preferred embodiment, the field-of-view limitingfunctionality limits the field-of-view of at least one of detectorelements 910 to a solid angle of less than or equal to 7 degrees.Reference is now made to FIGS. 15A, 15B, 15C and 15D, which aresimplified illustrations of four alternative embodiments of a portion ofan input device constructed and operative in accordance with anotherpreferred embodiment of the present invention, employing forward-facingdetector elements arranged behind edges of a display element. In thestructure of FIGS. 15A-15D, at least one detector assembly 960 isarranged behind at least one edge 962 of a viewing plane defining plate964 to sense light impinging onto detector assembly 960 afterpropagating through plate 964. Viewing plane defining plate 964 may be asingle or multiple layer plate and may have one or more coating layersassociated therewith. The light, preferably including light in the IRband, is emitted by a light beam emitter such as light beam emitter 128in the embodiment of FIG. 1B or a light reflecting object as in theembodiment of FIG. 1A. Preferably, detector assemblies 960 are providedbehind at least two mutually perpendicular edges 962, though detectorassemblies 960 may be provided behind all or most of edges 962.Alternatively, a single detector assembly 960 may be provided behindonly one of edges 962.

The detector assembly 960 includes a linear arrangement 968 of detectorelements 970. As distinct from the embodiments of FIGS. 10A-10D, thedetector assembly 960 does not comprise a support substrate onto whichis mounted a linear arrangement of detector elements. In the embodimentsof FIGS. 15A-15D, the support substrate of FIGS. 10A-10D is replaced bya portion of a peripheral housing 972. Similarly to the embodiments ofFIGS. 10A-10D there is provided a cover layer 974 which providesmultiple functions including physical protection, light intensitylimitation and field-of-view limitation, and may have optical power.

The peripheral housing 972 may be formed of any suitable materialincluding, for example, ceramic material, a material such as FR-4 whichis commonly used for PCBs, glass, plastic or a metal such as aluminum.The peripheral housing 972 may also provide mounting for and electricalconnections to the detector elements 970. A processor 976 for processingthe outputs of the detector elements 970 may also be mounted on theperipheral housing 972.

It is a particular feature of this embodiment of the present inventionthat the detector assembly 960 is extremely thin, preferably under 1 mmoverall. Accordingly, the linear arrangement 968 of detector elements970 is preferably 100-400 microns in thickness and the cover layer 974is preferably 100-500 microns in thickness.

The input devices shown in FIG. 15A-15D may also include a source oflight which is preferably external to the input device, for example asshown in FIG. 19. Suitable external light sources include sunlight,artificial room lighting and IR illumination emitted from a human bodyor other heat source. In an alternate preferred embodiment, the sourceof light may comprise an illumination subassembly 977 which typicallyincludes one or more electromagnetic radiation emitting sources, hereshown as multiple IR emitting LEDs 978. The illumination subassembly 977preferably forms part of the integrated display and input device.Examples of various suitable configurations of illumination subassembly977 are described herein below in FIGS. 18A-18F. Optionally, the lightemitted by LEDs 978 may be modulated by modulating circuitry (notshown).

In the embodiment of FIG. 15A, cover layer 974 is formed of glass or anyother suitable light transparent material. Reference is now made to FIG.15B, in which it is seen that cover layer 974 includes a field-of-viewdefining mask 980 having apertures 983 formed therein in sizes andarrangements which provide desired fields-of-view for the variouscorresponding detector elements 970. Each detector element 970 may haveassociated therewith a single aperture 983 as shown or a plurality ofsmaller apertures. Field-of-view limiting functionality may be desirablein this context because it enhances resolution by limiting overlapbetween the fields-of-view of adjacent detector elements 970. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 983 and their locations with respect to anddistances from detector elements 970. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 970 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 970 to a solidangle of less than or equal to 7 degrees. Reference is now made to FIG.15C, which differs from that of FIG. 15B in that apertures 983 in mask980 are replaced by light collimating tunnel-defining apertures 990 in amask 992.

Each detector element 970 may have associated therewith a singletunnel-defining aperture 990 as shown or a plurality of smallertunnel-defining apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 970. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 990 and their locations with respect to anddistances from detector elements 970. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 970 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 970 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 15D, which differs from that of FIGS. 15Band 15C in that the apertures in FIGS. 15B and 15C are replaced bylenses 993. Lenses 993 may be integrally formed with cover layer 974 ormay be discrete elements fitted within suitably sized and positionedapertures in cover layer 974. Lenses 993 may be associated withtunnel-defining apertures or may comprise an array of microlensesaligned with one or more of detector elements 970. Field-of-viewlimiting functionality may be desirable in this context because itenhances resolution by limiting overlap between the fields-of-view ofadjacent detector elements 970. Extent of field-of-view limiting may becontrolled by the size, pitch and arrangement of lenses 993 and theirlocations with respect to and distances from detector elements 970. Inaccordance with a preferred embodiment, the field-of-view limitingfunctionality limits the field-of-view of at least one of detectorelements 970 to a solid angle of less than or equal to 15 degrees. Inaccordance with another preferred embodiment, the field-of-view limitingfunctionality limits the field-of-view of at least one of detectorelements 970 to a solid angle of less than or equal to 7 degrees.Reference is now made to FIGS. 16A, 16B, 16C and 16D, which aresimplified illustrations of four alternative embodiments of a portion ofan input device constructed and operative in accordance with yet anotherpreferred embodiment of the present invention, employing forward-facingdetector elements arranged behind edges of a display element. In thestructure of FIGS. 16A-16D, at least one detector assembly 1000 isarranged behind at least one edge 1002 of a viewing plane defining plate1004 to sense light impinging on plate 1004 and propagating within theplate to the edges 1002 thereof. Viewing plane defining plate 1004 maybe a single or multiple layer plate and may have one or more coatinglayers associated therewith. Preferably, detector assemblies 1000 areprovided behind at least two mutually perpendicular edges 1002, thoughdetector assemblies 1000 may be provided behind all or most of edges1002.

Alternatively, a single detector assembly 1000 may be provided behindplate 1004 at only one edge thereof.

The detector assembly 1000 includes a linear arrangement 1008 ofdetector elements 1010. As distinct from the embodiments of FIGS.15A-15D, in the embodiments of FIGS. 16A-16D, the cover layer isobviated and its functionality is provided by suitable conditioning ofedge 1002 of viewing plane defining plate 1004.

This functionality may provide multiple functions including physicalprotection, light intensity limitation and field-of-view limitation, andmay have optical power.

As in the embodiment of FIGS. 15A-15D, detector assembly 1000 does notcomprise a support substrate onto which is mounted a linear arrangementof detector elements. In the embodiments of FIGS. 16A-16D, the supportsubstrate of FIGS. 11A-11D is replaced by a portion of a peripheralhousing 1012.

The peripheral housing 1012 may be formed of any suitable materialincluding, for example, ceramic material, a material such as FR-4 whichis commonly used for PCBs, glass, plastic or a metal such as aluminum.The peripheral housing 1012 may also provide mounting for and electricalconnections to the detector elements 1010.

A processor 1016 for processing the outputs of the detector elements1010 may also be mounted on the peripheral housing 1012.

It is a particular feature of this embodiment of the present inventionthat the detector assembly 1000 is extremely thin, preferably under 1 mmoverall.

Accordingly, the linear arrangement 1008 of detector elements 1010 ispreferably 100-400 microns in thickness.

The input devices shown in FIG. 16A-16D may also include a source oflight which is preferably external to the input device, for example asshown in FIG. 19. Suitable external light sources include sunlight,artificial room lighting and IR illumination emitted from a human bodyor other heat source. In an alternate preferred embodiment, the sourceof light may comprise an illumination subassembly 1017 which typicallyincludes one or more electromagnetic radiation emitting sources, hereshown as multiple IR emitting LEDs 1018. The illumination subassembly1017 preferably forms part of the integrated display and input device.Examples of various suitable configurations of the illuminationsubassembly 1017 are described herein below in FIGS. 18A-18F.Optionally, the light emitted by LEDs 1018 may be modulated bymodulating circuitry (not shown).

In the embodiment of FIG. 16A, a rearward facing surface 1019 of plate1004 at the edge 1002 lying in front of the linear arrangement 1008 isuniformly polished for unimpeded light transmission therethrough tolinear arrangement 1008 of detector elements 1010.

Reference is now made to FIG. 16B, in which it is seen that the rearwardfacing surface 1019 of plate 1004 at the edge 1002 lying in front of thelinear arrangement 1008 is conditioned to define a field-of-viewdefining mask 1020 having apertures 1033 formed therein in sizes andarrangements which provide desired fields-of-view for the variouscorresponding detector elements 1010. Each detector element 1010 mayhave associated therewith a single aperture 1033 as shown or a pluralityof smaller apertures.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 1010. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of apertures 1033 and their locations with respect to anddistances from detector elements 1010. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 1010 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 1010 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 16C, which differs from that of FIG. 16Bin that apertures 1033 in mask 1020 are replaced by light collimatingtunnel-defining apertures 1040 in a mask 1042.

Each detector element 1010 may have associated therewith a singletunnel-defining aperture 1040, as shown, or a plurality of smallertunnel-defining apertures. Field-of-view limiting functionality may bedesirable in this context because it enhances resolution by limitingoverlap between the fields-of-view of adjacent detector elements 1010.Extent of field-of-view limiting may be controlled by the size, pitchand arrangement of apertures 1040 and their locations with respect toand distances from detector elements 1010. In accordance with apreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 1010 to a solidangle of less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 1010 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIG. 16D, which differs from that of FIGS. 16Band 16C in that the apertures in FIGS. 16B and 16C are replaced bylenses 1053. Lenses 1053 may be integrally formed at edges 1002 or maybe discrete elements fitted within suitably sized and positionedapertures in plate 1004. Lenses 1053 may be associated withtunnel-defining apertures or may comprise an array of microlensesaligned with one or more of detector elements 1010.

Field-of-view limiting functionality may be desirable in this contextbecause it enhances resolution by limiting overlap between thefields-of-view of adjacent detector elements 1010. Extent offield-of-view limiting may be controlled by the size, pitch andarrangement of lenses 1053 and their locations with respect to anddistances from detector elements 1010. In accordance with a preferredembodiment, the field-of-view limiting functionality limits thefield-of-view of at least one of detector elements 1010 to a solid angleof less than or equal to 15 degrees. In accordance with anotherpreferred embodiment, the field-of-view limiting functionality limitsthe field-of-view of at least one of detector elements 1010 to a solidangle of less than or equal to 7 degrees.

Reference is now made to FIGS. 17A, 17B and 17C, which are simplifiedillustration of three alternative embodiments of a detector assemblyforming part of an integrated display and input device constructed andoperative in accordance with a preferred embodiment of the presentinvention.

In the structure of FIGS. 17A-17C, at least one” detector assembly isarranged about at least one edge (not shown) of a viewing plane definingplate (not shown). The detector assemblies of FIGS. 17A-17C may beemployed in any of the embodiments of the present invention describedhereinabove and illustrated in FIGS. 1A-16D. Preferably, detectorassemblies are provided along at least two mutually perpendicular edgesof the plate, though detector assemblies may be provided along all ormost of the edges. Alternatively, a single detector assembly may beprovided along only one edge of the plate.

In accordance with a preferred embodiment of the present invention, thedetector assembly comprises a support substrate onto which is mounted alinear arrangement of detector elements. Preferably, a cover layer isplaced over the arrangement of detector elements and may providemultiple functions including physical protection, light intensitylimitation and field-of-view limitation, and may have optical power. Thesupport substrate may be mounted onto a display housing (not shown) ormay be integrally formed therewith. The support substrate mayalternatively be mounted onto an edge of the plate. The supportsubstrate may be formed of a ceramic material, a material such as FR-4which is commonly used for PCBs, glass, plastic or a metal such asaluminum. The support substrate may also provide mounting for andelectrical connections to the detector elements. A processor forprocessing the outputs of the detector elements may also be mounted onthe support substrate.

It is a particular feature of this embodiment of the present inventionthat the detector assembly is extremely thin, preferably under 1 mmoverall. Accordingly, the support substrate is preferably 50-200 micronsin thickness and the linear arrangement of detector elements ispreferably 100-400 microns in thickness and the cover layer ispreferably 100-500 microns in thickness.

In the embodiment of FIG. 17A, the detector assembly, here designated byreference numeral 1100, includes an integrally formed multi-elementdetector array 1102. The detector array 1102 is preferably mounted ontoa support substrate 1104 and overlaid with a cover layer 1106.

In the embodiment of FIG. 17B, the detector assembly, here designated byreference numeral 1110, includes a plurality of discrete single-elementdetector elements 1112 such as Solderable Silicon Photodiodescommercially available from Advanced Photonix Incorporated of Camarillo,Calif., USA under catalog designator PDB-C601-1. The discrete detectorelements 1112 are preferably mounted onto a support substrate 1114 andoverlaid with a cover layer 1116.

In the embodiment of FIG. 17C, the detector assembly, here designated byreference numeral 1120, includes a plurality of discrete multi-elementdetector elements 1122. The discrete multi-element detector elements1122 need not be all of the same size and are preferably all mountedonto a support substrate 1124 and overlaid with a cover layer 1126.

Reference is now made to FIGS. 18A, 18B, 18C5′ 18D, 18E and 18F, whichare simplified illustrations of four alternative embodiments of anillumination subassembly forming part of an integrated display and inputdevice constructed and operative in accordance with preferredembodiments of the present invention. Alternatively or additionally, atouch responsive input functionality may preferably be operative todetect the position of a stylus (not shown) or any other suitablereflective object.

FIGS. 18A-18F show an integrated display and input device having touchresponsive input functionality, which is useful for applicationselection and operation, such as email communication and internetsurfing. The input functionality may incorporate any one or morefeatures of assignee's U.S. Provisional Patent Application Nos.60/715,546; 60/734,027; 60/789,188 and 60/682,604, U.S. PatentApplication Publication No. 2005/0156914A1 and PCT Patent ApplicationPublication No. WO 2005/094176, the disclosures of which are herebyincorporated by reference. FIGS. 18A-18F illustrate object detectionfunctionality of the type described hereinabove with reference to FIGS.1A to 1D. As shown, a position of a user's finger is detected by meansof a touch responsive input functionality operative in accordance withpreferred embodiments of the present invention.

Turning specifically to FIG. 18A, it is seen that arrays 1202 of lightdetector elements 1204 are arranged at least two mutually perpendicularedge surfaces 1206 of a viewing plane defining plate 1208.Alternatively, detector arrays 1202 may be provided along all or most ofthe edges 1206. As a further alternative, a single detector array 1202may be provided along only one edge 1206 of the plate 1208. Viewingplane defining plate 1208 may be a single or multiple layer plate andmay have one or more coating layers associated therewith.

It is appreciated that the phrase “at edges” is to be interpretedbroadly as including structures which are located behind edges, as inthe embodiments shown in FIGS. 10A-10D, 11A-11D, 15A-15D and 16A-16D,about edges as in the embodiments shown in FIGS. 9A-9D and 14A-14D, andalong edges as in the embodiments shown in FIGS. 4-7, 8A-8D, 12A-12D and13A-13D.

Suitable detector elements are, for example, Solderable SiliconPhotodiodes commercially available from Advanced Photonix Incorporatedof Camarillo, Calif., USA under catalog designator PDB-C601-1.

The integrated display and input device shown in FIG. 18A preferablyincludes an illumination subassembly 1212 which typically includes oneor more electromagnetic radiation emitting sources. The illuminationsubassembly 1212 preferably provides a baseline illumination level whichis typically detected by detector elements 1204.

In accordance with a preferred embodiment of the present invention,shown in FIG. 18A, a single IR emitting LED 1216 is provided at orgenerally adjacent to an intersection of the mutually perpendicularedges 1206 along which detector elements 1214 are arranged. The LED 1216is arranged such that light emitted therefrom is projected generallyacross the surface of plate 1208. A suitable IR emitting LED is, forexample, an IR-emitting SMD-LED commercially available from OSA OptoLight GmbH of Berlin, Germany under catalog designator OIS-210-X-T. Itis appreciated that selection of a specific shape and size of LED 1216may be affected by the specific placement of LED 1216 relative todetector arrays 1202 and the interaction between a light beam emittedfrom the LED 1216 and the various components of the integrated displayand input device, including the plate 1208, the detector elements 1204and other layers of the integrated display and input device. Optionally,the light emitted by LED 1216 may be modulated by modulating circuitry(not shown). Light, preferably including light in the IR band emitted byillumination subassembly 1212, is reflected from a user's finger, astylus (not shown) or any other suitable reflective object, touching orlocated in propinquity to plate 1208. The reflected light is propagatedwithin plate 1208 and is detected by one or more of detector elements1204. Alternatively or additionally, the reflected light is propagatedabove the surface of plate 1208 and is detected by one or more ofdetector elements 1204, which may extend slightly above edge surfaces1206. Furthermore, additionally or alternatively, the reflected lightmay propagate or be transmitted through plate 1208 directly to one ormore of detector elements 1204 and detected thereby.

When the user's finger touches or is located in propinquity to plate1208, the light reflected from the finger is detected by one or more ofdetector elements 1204, as described hereinabove, in addition to thebaseline level of light detected by the detector elements 1204. Detectoranalyzing processing circuitry (not shown) preferably receives outputsof the detector elements 1204 on detector arrays 1202, digitallyprocesses these outputs and determines whether the absolute amount oflight detected by each of the detector elements 1204 or the change inthe amount of light detected by each of the detector elements 1204exceeds a predetermined threshold.

The amount of light detected by the individual detector elements 1204 ona given detector array 1202, as determined by the detector analyzingprocessing circuitry, is further processed to provide an array detectionoutput. The array detection output includes information corresponding tothe location of an impingement point of the user's finger relative tothe given detector array 1202. Typically, the location of at least onedetector element 1204, in which the amount of light measured or thechange in the amount of light measured exceeds a predeterminedthreshold, corresponds to the location of the user's finger along anaxis parallel to the given detector array 1202.

In the configuration shown, in FIG. 18A, two-dimensional locationdetermining circuitry (not shown) preferably calculates thetwo-dimensional position of the impingement point of the user's fingeron or above plate 1208 by combining the array detection outputs of atleast two detector arrays, typically arranged along at least twomutually perpendicular edges 1206 of plate 1208.

Reference is now made to FIG. 18B, which shows arrays 1222 of lightdetector elements 1224 arranged at least two mutually perpendicular edgesurfaces 1226 of a viewing plane defining plate 1228. Alternatively,detector arrays 1222 may be provided along all or most of the edges1226. As a further alternative, a single detector array 1222 may beprovided along only one edge 1226 of the plate 1228. Viewing planedefining plate 1228 may be a single or multiple layer plate and may haveone or more coating layers associated therewith.

It is appreciated that the phrase “at edges” is to be interpretedbroadly as including structures which are located behind edges, as inthe embodiments shown in FIGS. 10A-10D, 11A-11D, 15A-15D and 16A-16D,about edges as in the embodiments shown in FIGS. 9A-9D and 14A-14D, andalong edges as in the embodiments shown in FIGS. 4-7, 8A-8D, 12A-12D and13A-13D.

Suitable detector elements are, for example/Solderable SiliconPhotodiodes commercially available from Advanced Photonix Incorporatedof Camarillo, Calif., USA under catalog designator PDB-C601-1.

The integrated display and input device shown in FIG. 18B preferablyincludes an illumination subassembly 1232 which typically includes oneor more electromagnetic radiation emitting sources. The illuminationsubassembly 1232 preferably provides a baseline illumination level whichis typically detected by detector elements 1224.

In accordance with a preferred embodiment of the present invention,shown in FIG. 18B, a single IR emitting LED 1236 is provided at orgenerally adjacent to an intersection of mutually perpendicular edges1226 along which detector elements 1224 are not arranged. The LED 1236is arranged such that light emitted therefrom is projected generallyacross the surface of plate 1228. A suitable IR emitting LED is, forexample, an IR-emitting SMD-LED commercially available from OSA OptoLight GmbH of Berlin, Germany under catalog designator OIS-210-X-T. Itis appreciated that selection of a specific shape and size of LED 1236may be affected by the specific placement of LED 1236 relative todetector arrays 1222 and the interaction between a light beam emittedfrom the LED 1236 and the various components of the integrated displayand input device, including the plate 1228, the detector elements 1224and other layers of the integrated display and input device. Optionally,the light emitted by LED 1236 may be modulated by modulating circuitry(not shown). Light, preferably including light in the IR band emitted byillumination subassembly 1232, is propagated generally across thesurface of plate 1228 and is detected by one or more of detectorelements 1224. Alternatively or additionally, the light is propagatedabove the surface of plate 1228 and is detected by one or more ofdetector elements 1224, which may optionally extend slightly above edgesurfaces 1226. Furthermore, additionally or alternatively, the light maypropagate or be transmitted through plate 1228 directly to one or moreof detector elements 1224 and detected thereby.

The light is deflected by a user's finger, a stylus (not shown) or anyother suitable object, touching or located in propinquity to plate 1228.When the user's finger touches or is located in propinquity to plate1228, the amount of light detected by one or more of detector elements1224 is typically reduced relative to the baseline level of lightdetected by the detector elements 1224. Detector analyzing processingcircuitry (not shown) preferably receives outputs of the detectorelements 1224 on detector arrays 1222, digitally processes these outputsand determines whether the absolute amount of light detected by each ofthe detector elements 1224 is below a predetermined threshold, orwhether the change in the amount of light detected by each of thedetector elements 1224 exceeds a predetermined threshold.

The amount of light detected by the individual detector elements 1224 ona given detector array 1222, as determined by the detector analyzingprocessing circuitry, is further processed to provide an array detectionoutput. The array detection output includes information corresponding tothe location of an impingement point of the user's forger relative tothe given detector array 1222. Typically, the location of at least onedetector element 1224, in which the amount of light measured is below apredetermined threshold or the change in the amount of light measuredexceeds a predetermined threshold, corresponds to the location of theuser's finger along an axis parallel to the given detector array 1222.In the configuration shown in FIG. 18B, two-dimensional locationdetermining circuitry (not shown) preferably calculates thetwo-dimensional position of the impingement point of the user's fingeron or above plate 1228 by combining the array detection outputs of atleast two detector arrays, typically arranged along at least twomutually perpendicular edges 1226 of plate 1228. Reference is now madeto FIG. 18C, which shows an array 1242 of detector elements 1244arranged in a plane, parallel to a viewing plane 1246. As seen in FIG.18C, in one example of a display and input device structure, detectorarray 1242 is arranged behind an IR transmissive display panel 1248,such as a panel including LCD or OLED elements, underlying a viewingplane defining plate 1250. In accordance with a preferred embodiment ofthe present invention the array 1242 is formed of a plurality ofdiscrete detector elements 1244 placed on a plane integrally formedtherewith.

Alternatively, the array 1242 may be formed of one or more CCD or CMOSarrays, or may be created by photolithography.

Viewing plane defining plate 1250 may be a single or multiple layerplate and may have one or more coating layers associated therewith. Inone example of an integrated display and input system employing an LCD,there are provided one or more light diffusing layers 1252 overlying areflector 1254. One or more collimating layers 1256 are typicallyinterposed between reflector 1254 and IR transmissive display panel1248.

The integrated display and input device shown in FIG. 18C preferablyincludes an illumination subassembly 1262 which typically includes oneor more electromagnetic radiation emitting sources. The illuminationsubassembly 1262 preferably provides a baseline illumination level whichis typically detected by detector elements 1244.

In accordance with a preferred embodiment of the present invention,shown in FIG. 18C, a generally linear arrangement of multiple IRemitting LEDs 1266 is provided, in parallel with one or more of edges1268 of the integrated display and input device. The LEDs 1266 arearranged such that light emitted therefrom is projected generally acrossthe surface of plate 1208. Suitable IR emitting LEDs are, for example,IR-emitting SMD-LEDs commercially available from OSA Opto Light GmbH ofBerlin, Germany under catalog designator OIS-210-X-T. It is appreciatedthat selection of a specific shapes and sizes of LEDs 1266 may beaffected by the specific placement of the LEDs 1266 relative to array1242 and the interaction between light beams emitted from the LEDs 1266and the various components of the integrated display and input device,including the plate 1250, the detector elements 1244, the diffusinglayers 1252, collimating layers 1256, reflecting layers 1254 and otherlayers of the integrated display and input device. Optionally, the lightemitted by LEDs 1266 may be modulated by modulating circuitry (notshown).

Light, preferably including light in the IR band emitted by illuminationsubassembly 1262, is reflected from a user's finger, a stylus (notshown) or any other suitable reflective object, touching or located inpropinquity to plate 1250. The reflected light is propagated throughplate 1250 and is detected by one or more of detector elements 1244.

When the user's finger touches or is located in propinquity to plate1250, the light reflected from the finger is detected by one or more ofdetector elements 1244, as described hereinabove, in addition to thebaseline level of light detected by the detector elements 1244. Detectoranalyzing processing circuitry (not shown) preferably receives outputsof the detector elements 1244 on detector array 1242, digitallyprocesses these output and determines whether the absolute amount oflight detected by each of the detector elements 1244 or the change inthe amount of light detected by each of the detector elements 1244exceeds a predetermined threshold.

The amount of light detected by the individual detector elements 1244 asdetermined by the detector analyzing processing circuitry is furtherprocessed to provide an array detection output. The array detectionoutput includes information corresponding to the location of animpingement point of the user's finger relative to array 1242.Typically, the location of at least one detector element 1244, in whichthe amount of light measured or the change in the amount of lightmeasured exceeds a predetermined threshold, corresponds to thetwo-dimensional location of the user's finger in a plane parallel toarray 1242.

In the configuration shown in FIG. 18C, optional three-dimensionallocation determining circuitry (not shown) may be provided to calculatethe three-dimensional (X, Y, Z and/or angular orientation) position ofthe impingement point of the user's finger on or above plate 1250 byprocessing the detector element outputs of at least two detectorelements to define the shape and size of an impingement area, asdescribed in assignee's U.S. Provisional Patent Application Nos.60/715,546; 60/734,027; 60/789,188 and 60/682,604, U.S. PatentApplication Publication No. 2005/0156914A1 and PCT Patent ApplicationPublication No. WO 2005/094176, the disclosures of which are herebyincorporated by reference.

Reference is now made FIG. 18D, which shows arrays 1272 of lightdetector elements 1274 arranged at least two mutually perpendicular edgesurfaces 1276 of a viewing plane defining plate 1278. Alternatively,detector arrays 1272 may be provided along all or most of the edges1276. As a further alternative, a single detector array 1272 may beprovided along only one edge 1276 of the plate 1278. Viewing planedefining plate 1278 may be a single or multiple layer plate and may haveone or more coating layers associated therewith. Optionally, one or moreof detector arrays 1272 may be arranged such that the detector elements1274 thereof extend slightly above the surface of viewing plane definingplate 1278.

It is appreciated that the phrase “at edges” is to be interpretedbroadly as including structures which are located behind edges, as inthe embodiments shown in FIGS. 10A-10D, 11A-11D, 15A-15D and 16A-16D,about edges as in the embodiments shown in FIGS. 9A-9D and 14A-14D, andalong edges as in the embodiments shown in FIGS. 4-7, 8A-8D, 12A-12D and13A-13D.

Suitable detector elements are, for example, Solderable SiliconPhotodiodes commercially available from Advanced Photonix Incorporatedof Camarillo, Calif., USA under catalog designator PDB-C601-1.

The integrated display and input device shown in FIG. 18D preferablyincludes an illumination subassembly 1282 which typically includes oneor more electromagnetic radiation emitting sources. The illuminationsubassembly 1282 preferably provides a baseline illumination level whichis typically detected by detector elements 1274.

In accordance with a preferred embodiment of the present invention,shown in FIG. 18D, one or more IR emitting LEDs 1286 is provided at,generally adjacent to, or interspersed among, a linear arrangement ofdisplay backlight LEDs (not shown), typically provided underlying andaligned with edges of a plane of an IR transmissive display panel 1288,such as an LCD or OLED, which underlies and is generally parallel to aviewing plane defining plate 1278.

A suitable IR emitting LED is, for example, an SMD type IR GaAs LEDcommercially available from Marubeni America Corporation of Santa Clara,Calif., USA under catalog designator SMC940. It is appreciated thatselection of a specific shapes and sizes of LEDs 1286 may be affected bythe specific placement of LEDs 1286 relative to detector arrays 1272 andthe interaction between light beams emitted from the LEDs 1286, lightbeams emitted from other backlight LEDs, and the various components ofthe integrated display and input device, including backlight LEDs, theplate 1278, the detector elements 1274 and other layers of theintegrated display and input device. Optionally, the light emitted byLED 1286 may be modulated by modulating circuitry (not shown).

In one preferred embodiment of the present invention, the detectorelements 1274 are operative to detect visible wavelengths of lightemitted from visible light-admitting backlight LEDs. In anotherpreferred embodiment of the present invention, backlight LEDs areselected to provide both IR and visible light wavelength emanations.

The IR emitting LEDs 1286 are arranged such that light emitted therefromis projected generally through one or more diffusing and/or collimatinglayers 1290 typically underlying the IR transmissive display panel 1288.The IR emitting LEDs 1286 may additionally or alternatively be arrangedsuch that light emitted therefrom is reflected by one or more reflectinglayers 1292, underlying and generally parallel to the plane of the IRtransmissive display panel 1288. Typically, both diffusing layers 1290and reflecting layers 1292 are provided, to aid in propagating thebacklight and IR light through the transmissive display panel 1288.

Light, preferably including light in the IR band emitted by illuminationsubassembly 1282, is reflected from a user's finger, a stylus (notshown) or any other suitable reflective object, touching or located inpropinquity to plate 1278. The reflected light is propagated withinplate 1278 and is detected by one or more of detector elements 1274.Alternatively or additionally, the reflected light is propagated abovethe surface of plate 1278 and is detected by one or more of detectorelements 1274, which may extend slightly above edge surfaces 1276.Furthermore, additionally or alternatively, the reflected light maypropagate or be transmitted through plate 1278 directly to one or moreof detector elements 1274 and detected thereby.

When the user's finger touches or is located in propinquity to plate1278, the light reflected from the finger is detected by one or more ofdetector elements 1274, as described hereinabove, in addition to thebaseline level of light detected by the detector elements 1274. Detectoranalyzing processing circuitry (not shown) preferably receives outputsof the detector elements 1274 on detector arrays 1272, digitallyprocesses these outputs and determines whether the absolute amount oflight detected by each of the detector elements 1274 or the change inthe amount of light detected by each of the detector elements 1274exceeds a predetermined threshold.

The amount of light detected by the individual detector elements 1274 ona given detector array 1272, as determined by the detector analyzingprocessing circuitry, is further processed to provide an array detectionoutput. The array detection output includes information corresponding tothe location of an impingement point of the user's finger relative tothe given detector array 1272. Typically, the location of at least onedetector element 1274, in which the amount of light measured or thechange in the amount of light measured exceeds a predeterminedthreshold, corresponds to the location of the user's finger along anaxis parallel to detector array 1272.

In the configuration shown in FIG. 18D, two-dimensional locationdetermining circuitry (not shown) preferably calculates thetwo-dimensional position of the impingement point of the user's fingeron or above plate 1278 by combining the array detection outputs of atleast two arrays, typically arranged along at least two mutuallyperpendicular edges 1276 of plate 1278.

Reference is now made to FIG. 18E, which shows a single array 1302 oflight detector elements 1304 arranged at an edge surface 1306 of aviewing plane defining plate 1308. Viewing plane defining plate 1308 maybe a single or multiple layer plate and may have one or more coatinglayers associated therewith.

It is appreciated that the phrase “at an edge” is to be interpretedbroadly as including structures which are located behind an edge, as inthe embodiments shown in FIGS. 10A-10D, 11A-11D, 15A-15D and 16A-16D3about an edge as in the embodiments shown in FIGS. 9A-9D and 14A-14D,and along an edge as in the embodiments shown in FIGS. 4-7, 8A-8D,12A-12D and 13A-13D.

Suitable detector elements are, for example, Solderable SiliconPhotodiodes commercially available from Advanced Photonix Incorporatedof Camarillo, Calif., USA under catalog designator PDB-C601-1.

The integrated display and input device shown in FIG. 18E preferablyincludes an illumination subassembly 1312 which typically includes oneor more electromagnetic radiation emitting sources. The illuminationsubassembly 1312 preferably provides a baseline illumination level whichis typically detected by detector elements 1304.

In accordance with a preferred embodiment of the present invention,shown in FIG. 18E, a generally linear arrangement of multiple IRemitting LEDs 1316 is provided, in parallel with one or more of edges1306, The LEDs 1316 are arranged such that light emitted therefrom isprojected generally across the surface of plate 1308.

Illumination subassembly 1312 may be arranged in parallel to detectorarray 1302, at an edge perpendicular to detector array 1302, or may bearranged at an edge opposite or otherwise not adjacent or perpendicularto detector array 1302.

Suitable IR emitting LEDs are, for example, the IR-emitting SMD-LEDscommercially available from OSA Opto Light GmbH of Berlin, Germany undercatalog designator OIS-210-X-T. It is appreciated that selection of aspecific shapes and sizes of LEDs 1316 may be affected by the specificplacement of the illumination subassembly 1312 relative to detectorarray 1302 and the interaction between light beams emitted from the LEDs1316 and the various components of the integrated display and inputdevice, including the plate 1308, the detector elements 1304 and otherlayers of the integrated display and input device. Optionally, the lightemitted by LEDs 1316 may be modulated by modulating circuitry (notshown).

Light, preferably including light in the IR band emitted by illuminationsubassembly 1312, is reflected from a user's finger, a stylus (notshown) or any other suitable reflective object, touching or located inpropinquity to plate 1308. The reflected light is propagated withinplate 1308 and is detected by one or more of detector elements 1304.Alternatively or additionally, the reflected light is propagated abovethe surface of plate 1308 and is detected by one or more of detectorelements 1304, which may extend slightly above edge surfaces 1306.Furthermore, additionally or alternatively, the reflected light maypropagate or be transmitted through plate 1308 directly to one or moreof detector elements 1304 and detected thereby.

When the user's finger touches or is located in propinquity to plate1308, the light reflected from the finger is detected by one or more ofdetector elements 1304, as described hereinabove, in addition to thebaseline level of light detected by the detector elements 1304. Detectoranalyzing processing circuitry (not shown) preferably receives outputsof the detector elements 1304 on detector array 1302, digitallyprocesses these outputs and determines whether the absolute amount oflight detected by each of the detector elements 1304 or the change inthe amount of light detected by each of the detector elements 1304exceeds a predetermined threshold. The amount of light detected by theindividual detector elements 1304 on array 1302, as determined by thedetector analyzing processing circuitry, is further processed to providean array detection output. The array detection output includesinformation corresponding to the location of an impingement point of theuser's finger relative to detector array 1302. Typically, the locationof at least one detector element 1304, in which the amount of lightmeasured or the change in the amount of light measured exceeds apredetermined threshold, corresponds to the location of the user'sfinger along an axis parallel to array 1302.

In the configuration shown in FIG. 18E, two-dimensional locationdetermining circuitry (not shown) preferably calculates thetwo-dimensional position of the impingement point of the user's fingeron or above plate 1308 by further utilizing the array detection outputand the information corresponding to the location of the impingementpoint of the user's finger relative to the array included therein, asdescribed herein below.

Whereas the location of at least one detector element 1304 on array1302, in which the amount of light measured or the change in the amountof light measured exceeds a predetermined threshold, corresponds to thelocation of the user's finger along an axis parallel to array 1302, thestrength of the signal output of that detector element 1304 decreases asthe distance of the impingement point of the user's finger from array1302 along an axis generally perpendicular to the axis of the array 1302increases. Conversely, the strength of the signal output of the detectorelement 1304 increases as the distance of the impingement point of theuser's finger from array 1302 along an axis generally perpendicular tothe axis of the array 1302 decreases. These characteristics of thevarious components of the integrated display and input device areemployed by the two-dimensional location determining circuitry tocalculate the two-dimensional position of the impingement point of theuser's finger on the plate 1308 or above it. Reference is now made toFIG. 18F, which shows an integrated display and input device havingtouch responsive input functionality. As seen in FIG. 18F, amultiplicity of light detector elements 1322 are interspersed amonglight emitters 1324 arranged in a plane 1326 underlying a viewing planedefining plate 1328. Examples of such a structure are described in U.S.Pat. No. 7,034,866 and U.S. Patent Application Publication Nos.2006/0132463 A1, 2006/0007222 A1 and 2004/00012565A1, the disclosures ofwhich are hereby incorporated by reference.

Viewing plane defining plate 1328 may be a single or multiple layerplate and may have one or more coating layers associated therewith. Inone example of an integrated display and input system employing lightdetector elements interspersed among light emitting elements, there areprovided one or more light diffusing layers 1330 overlying a reflector1332. One or more collimating layers 1334 may be interposed betweenreflector 1332 and the plane 1326 which includes the light detector andlight emitting elements.

The integrated display and input device shown in FIG. 18F preferablyincludes an illumination subassembly 1342 which typically includes oneor more electromagnetic radiation emitting sources. The illuminationsubassembly 1342 preferably provides a baseline illumination level whichis typically detected by detector elements 1322.

In accordance with a preferred embodiment of the present invention,shown in FIG. 18F, a generally linear arrangement of multiple IRemitting LEDs 1346 is provided, generally in parallel with one or moreof edges 1348 of plate 1328. The LEDs 1246 are arranged such that lightemitted therefrom is projected generally across the surface of plate1328. Suitable IR emitting LEDs are, for example, IR-emitting SMD-LEDscommercially available from OSA Opto Light GmbH of Berlin, Germany undercatalog designator OIS-210-X-T. It is appreciated that selection of aspecific shapes and sizes of LEDs 1346 may be affected by the specificplacement of the LEDs 1346 relative to plane 1326 and the interactionbetween one or more light beams emitted from LEDs 1346 and the variouscomponents of the integrated display and input device including theplate 1328, the detector elements 1322, diffusing layers 1330,collimating layers 1334, reflecting layers 1332 and other layers of theintegrated display and input device. Optionally, the light emitted byLEDs 1346 may be modulated by modulating circuitry (not shown).

Light, preferably including light in the IR band emitted by illuminationsubassembly 1342, is reflected from a user's finger, a stylus (notshown) or any other suitable reflective object, touching or located inpropinquity to plate 1328. The reflected light is propagated throughplate 1328 and is detected by one or more of detector elements 1322.

When the user's finger touches or is located in propinquity to plate1328, the light reflected from the finger is detected by one or more ofdetector elements 1322, in addition to the baseline level of lightdetected by the detector elements 1322. Detector analyzing processingcircuitry preferably receives outputs of the detector elements 1322,digitally processes these outputs and determines whether the absoluteamount of light detected by each of the detector elements 1322 or thechange in the amount of light detected by each of the detector elements1322 exceeds a predetermined threshold.

The amount of light detected by the individual detector elements 1322,as determined by the detector analyzing processing circuitry, is furtherprocessed to provide an array detection output. The array detectionoutput includes information corresponding to the location of animpingement point of the user's finger. Typically, the location of atleast one detector element 1322, in which the amount of light measuredor the change in the amount of light measured exceeds a predeterminedthreshold, corresponds to the two-dimensional location of the user'sfinger on or above plate 1328 and parallel to plane 1326.

In the configuration shown in FIG. 18F, optional three-dimensionallocation determining circuitry (not shown) may be provided to calculatethe three-dimensional (X, Y, Z and/or angular orientation) position ofthe impingement point of the user's finger on or above plate 1328 byprocessing the detector element outputs of at least two detectorelements to define the shape and size of an impingement area, asdescribed in assignee's U.S. Provisional Patent Application Nos.60/715,546; 60/734,027; 60/789,188 and 60/682,604, U.S. PatentApplication Publication No. 2005/0156914A1 and PCT Patent ApplicationPublication No. WO 2005/094176, the disclosures of which are herebyincorporated by reference.

It is appreciated that any of the configurations of the illuminationsubassemblies shown in the embodiments of FIGS. 18A-18F may be combinedwith any of the detector array configurations shown in FIGS. 1-18F.

Reference is now made to FIG. 19, which is a simplified illustration ofan integrated display and input device constructed and operative inaccordance with a preferred embodiment of the present invention,utilizing electromagnetic radiation from a source external to theintegrated display and input device.

As seen in FIG. 19, arrays 1402 of light detector elements 1404 arearranged at least two mutually perpendicular edge surfaces 1406 of aviewing plane defining plate 1408. Alternatively, detector arrays 1402may be provided along all or most of the edges 1406. As a furtheralternative, a single detector array 1402 may be provided along only oneedge 1406 of the plate 1408. Viewing plane defining plate 1408 may be asingle or multiple layer plate and may have one or more coating layersassociated therewith.

It is appreciated that the phrase “at edges” is to be interpretedbroadly as including structures which are located behind edges, as inthe embodiments shown in FIGS. 10A-10D, 11A-11D, 15A-15D and 16A-16D,about edges as in the embodiments shown in FIGS. 9A-9D and 14A-14D, andalong edges as in the embodiments shown in FIGS. 4-7, 8A-8D, 12A-12D and13A-13D.

Suitable detector elements are, for example, Solderable SiliconPhotodiodes commercially available from Advanced Photonix Incorporatedof Camarillo, Calif., USA under catalog designator PDB-C601-1.

Light incident upon the viewing plate 1408, preferably including lightin the IR band emitted by one or more sources of illumination externalto the integrated display and input device, is propagated within plate1408 and is detected by one or more of detector elements 1404.Alternatively or additionally, the incident light is propagated abovethe surface of plate 1408 and is detected by one or more of detectorelements 1404, which may extend slightly above edge surfaces 1406.Furthermore, additionally or alternatively, the incident light maypropagate or be transmitted through plate 1408 directly to one or moreof detector elements 1404 and detected thereby. The detection ofincident light by detector elements 1404 defines a baseline illuminationlevel therefore. Light, preferably including light in the IR bandemitted by one or more sources of illumination external to theintegrated display and input device, is reflected from a user's finger,a stylus (not shown) or any other suitable reflective object, touchingor located in propinquity to plate 1408. The reflected light ispropagated within plate 1408 and is detected by one or more of detectorelements 1404. Alternatively or additionally, the reflected light ispropagated above the surface of plate 1408 and is detected by one ormore of detector elements 1404, which may extend slightly above edgesurfaces 1406. Furthermore, additionally or alternatively, the reflectedlight may propagate or be transmitted through plate 1408 directly to oneor more of detector elements 1404 and detected thereby.

Suitable external light sources include sunlight, artificial roomlighting and IR illumination emitted from a human body or other heatsource. In an alternate preferred embodiment, the quantity or intensityof the reflected light may be augmented by the addition of anillumination subassembly 1412 which typically includes one or moreelectromagnetic radiation emitting sources. Examples of various suitableconfigurations of illumination subassembly 1412 are describedhereinabove with reference to FIGS. 18A-18F. When the user's fingertouches or is located in propinquity to plate 1408, the light reflectedfrom the finger is detected by one or more of detector elements 1404, asdescribed hereinabove, in addition to the baseline level of lightdetected by the detector elements 1404. Detector analyzing processingcircuitry (not shown) preferably receives outputs of the detectorelements 1404 on arrays 1402, digitally processes these outputs anddetermines whether the absolute amount of light detected by each of thedetector elements 1404 or the change in the amount of light detected byeach of the detector elements 1404 exceeds a predetermined threshold.

The amount of light detected by the individual detector elements 1404 ona given array 1402, as determined by the detector analyzing processingcircuitry, is further processed to provide an array detection output.The array detection output includes information corresponding to thelocation of an impingement point of the user's finger relative to thegiven array 1402. Typically, the location of at least one detectorelement 1404, in which the amount of light measured or the change in theamount of light measured exceeds a predetermined threshold, correspondsto the location of the user's finger along an axis parallel to array1402.

In the configuration shown in FIG. 19, two-dimensional locationdetermining circuitry (not shown) preferably calculates thetwo-dimensional position of the impingement point of the user's fingeron or above plate 1408 by combining the array detection outputs of atleast two arrays, typically arranged along at least two mutuallyperpendicular edges 1406 of plate 1408.

Reference is now made to FIGS. 20A, 20B, 21A, 21B and 22, which aresimplified illustrations of an alternative embodiment of an illuminationsubassembly forming part of an integrated display and input deviceconstructed and operative in accordance with another preferredembodiment of the present invention. Alternatively or additionally, atouch responsive input functionality and/or propinquity responsive inputfunctionality may preferably be operative to detect the positions of oneor more fingers, a stylus (not shown) or any other suitable reflectiveobject.

FIGS. 20A-22 show an integrated display and input device having touchresponsive input functionality and/or propinquity responsive inputfunctionality, which is useful for application selection and operation,such as email communication and internet surfing. The inputfunctionality may incorporate any one or more features of assignee'sU.S. Provisional Patent Application Nos. 60/715,546; 60/734,027;60/789,188 and 60/682,604, U.S. Patent Application Publication No.2005/0156914A1 and PCT Patent Application Publication No. WO2005/094176, the disclosures of which are hereby incorporated byreference.

FIGS. 20A-22 illustrate object detection functionality of the typedescribed hereinabove with reference to FIGS. 1A to 1D. As shown, aposition of a user's fingers is detected by means of a touch responsiveinput functionality and/or propinquity responsive input functionalityoperative in accordance with preferred embodiments of the presentinvention.

As seen in FIGS. 20A-22, it is seen that arrays 1502 of light detectorelements 1504 are arranged at least two mutually perpendicular edgesurfaces 1506 of a viewing plane defining plate 1508. Alternatively,detector arrays 1502 may be provided along all or most of the edges1506. As a further alternative, a single detector array 1502 may beprovided along only one edge 1506 of the plate 1508. Viewing planedefining plate 1508 may be a single or multiple layer plate and may haveone or more coating layers associated therewith.

It is appreciated that the phrase “at edges” is to be interpretedbroadly as including structures which are located behind edges, as inthe embodiments shown in FIGS. 10A-10D, 11A-11D, 15A-15D and 16A-16D,about edges as in the embodiments shown in FIGS. 9A-9D and 14A-14D andalong edges as in the embodiments shown in FIGS. 4-7, 8A-8D 12A-12D and13A-13D.

Suitable detector elements are, for example, Solderable SiliconPhotodiodes commercially available from Advanced Photonix Incorporatedof Camarillo, Calif., USA under catalog designator PDB-C601-1.

The integrated display and input device shown in FIGS. 20A-22preferably, includes an illumination subassembly 1512 which typicallyincludes one or more electromagnetic radiation emitting sources. Theillumination subassembly 1512 preferably provides a baselineillumination level which is typically detected by detector elements1504.

In accordance with a preferred embodiment of the present invention,shown in FIGS. 20A-22, a single IR emitting LED 1516 is provided at orgenerally adjacent to an intersection of the mutually perpendicularedges 1506 along which detector elements 1514 are arranged. The LED 1516is arranged such that light emitted therefrom is projected generallyacross the surface of plate 1508. A suitable IR emitting LED is, forexample, an IR-emitting SMD-LED commercially available from OSA OptoLight GmbH of Berlin, Germany under catalog designator OIS-210-X-T. Itis appreciated that selection of a specific shape and size of LED 1516may be affected by the specific placement of LED 1516 relative todetector arrays 1502 and the interaction between a light beam emittedfrom the LED 1516 and the various components of the integrated displayand input device, including the plate 1508, the detector elements 1504and other layers of the integrated display and input device. Optionally,the light emitted by LED 1516 may be modulated by modulating circuitry(not shown).

Light, preferably including light in the IR band emitted by illuminationsubassembly 1512, is reflected from a user's fingers, a stylus (notshown) or any other suitable reflective object, touching or located inpropinquity to plate 1508. The reflected light is propagated withinplate 1508 and is detected by one or more of detector elements 1504.Alternatively or additionally, the reflected light is propagated abovethe surface of plate 1508 and is detected by one or more of detectorelements 1504, which may extend slightly above edge surfaces 1506.Furthermore, additionally or alternatively, the reflected light maypropagate or be transmitted through plate 1508 directly to one or moreof detector elements 1504 and detected thereby.

As seen in FIGS. 20A and 20B, the user's fingers are adjacent to oneanother. In FIG. 20A, the user's fingers are located in propinquity toplate 1508, at a height H therefrom, and in FIG. 20B, the user's fingerstouch plate 1508.

When the user's fingers'touch, as in FIG. 20B, or is located inpropinquity to, as in FIG. 20A, plate 1508, the light reflected from thefingers is detected by one or more of detector elements 1504, asdescribed hereinabove, in addition to the baseline level of lightdetected by the detector elements 1504. Detector analyzing processingcircuitry (not shown) preferably receives outputs of the detectorelements 1504 on detector arrays 1502, digitally processes these outputsand determines whether the absolute amount of light detected by each ofthe detector elements 1504 or the change in the amount of light detectedby each of the detector elements 1504 exceeds a predetermined threshold.It is noted that the finger which is closer to the plate produces asmaller, more intense, light pattern while the finger which is furtherfrom the plate produces a larger, more diffuse light pattern. Thesepatterns are readily detected and distinguished by the array 1502 ofdetector elements 1504.

The amount of light detected by the individual detector elements 1504 ona given detector array 1502, as determined by the detector analyzingprocessing circuitry, is further processed to provide an array detectionoutput. The array detection output includes information corresponding tothe locations of impingement points of the user's fingers relative tothe given detector array 1502. Typically, the locations of at least onedetector element 1504, in which the amount of light measured or thechange in the amount of light measured exceeds a predeterminedthreshold, correspond to the locations of the user's fingers along anaxis parallel to the given detector array 1502.

In the configuration shown in FIGS. 20A and 20B, two-dimensionallocation determining circuitry (not shown) preferably calculates thetwo-dimensional position of the impingement points of the user's fingerson or above plate 1508 by combining the array detection outputs of atleast two detector arrays, typically arranged along at least twomutually perpendicular edges 1506 of plate 1508.

As seen in FIGS. 21A and 21B, the user's fingers are located at adistance from one another. In FIG. 21A, the user's fingers are locatedin propinquity to plate 1508, at respective heights H1 and H2 therefrom,and in FIG. 21B, the user's fingers touch plate 1508. It is appreciatedthat H1 may be less than, equal to or greater than H2.

When the user's fingers touches, as in FIG. 21B, or is located inpropinquity to, as in FIG. 21A, plate 1508, the light reflected from thefingers is detected by one or more of detector elements 1504, asdescribed hereinabove, in addition to the baseline level of lightdetected by the detector elements 1504. Detector analyzing processingcircuitry (not shown) preferably receives outputs of the detectorelements 1504 on detector arrays 1502, digitally processes these outputsand determines whether the absolute amount of light detected by each ofthe detector elements 1504 or the change in the amount of light detectedby each of the detector elements 1504 exceeds a predetermined threshold.The amount of light detected by the individual detector elements 1504 ona given detector array 1502, as determined by the detector analyzingprocessing circuitry, is further processed to provide an array detectionoutput. The array detection output includes information corresponding tothe locations of impingement points of the user's fingers relative tothe given detector array 1502. Typically, the locations of at least onedetector element 1504, in which the amount of light measured or thechange in the amount of light measured exceeds a predeterminedthreshold, correspond to the locations of the user's fingers along anaxis parallel to the given detector array 1502.

In the configuration shown in FIGS. 21A and 21B, two-dimensionallocation determining circuitry (not shown) preferably calculates thetwo-dimensional position of the impingement points of the user's fingerson or above plate 1508 by combining the array detection outputs of atleast two detector arrays, typically arranged along at least twomutually perpendicular edges 1506 of plate 1508.

As seen in FIG. 22, one of the user's fingers is located in propinquityto but not touching plate 1508 and one of the user's fingers is touchingplate 1508. When the user's fingers touch, or are located in propinquityto, plate 1508, the light reflected from the fingers is detected by oneor more of detector elements 1504, as described hereinabove, in additionto the baseline level of light detected by the detector elements 1504.Detector analyzing processing circuitry (not shown) preferably receivesoutputs of the detector elements 1504 on detector arrays 1502, digitallyprocesses these outputs and determines whether the absolute amount oflight detected by each of the detector elements 1504 or the change inthe amount of light detected by each of the detector elements 1504exceeds a predetermined threshold.

The amount of light detected by the individual detector elements 1504 ona given detector array 1502, as determined by the detector analyzingprocessing circuitry, is further processed to provide an array detectionoutput. The array detection output includes information corresponding tothe locations of impingement points of the user's fingers relative tothe given detector array 1502. Typically, the locations of at least onedetector element 1504, in which the amount of light measured or thechange in the amount of light measured exceeds a predeterminedthreshold, correspond to the locations of the user's fingers along anaxis parallel to the given detector array 1502.

In the configuration shown in FIG. 22, two-dimensional locationdetermining circuitry (not shown) preferably calculates thetwo-dimensional position of the impingement points of the user's fingerson or above plate 1508 by combining the array detection outputs of atleast two detector arrays, typically arranged along at least twomutually perpendicular edges 1506 of plate 1508. As seen in theembodiment of FIG. 22, it is seen that the touching/non-touchingpositions of the two fingers are distinguishable from each other. In theillustrated embodiment, when one finger touches the screen and the otherdoes not but is located in propinquity thereto, the utilizationcircuitry may, for example, be responsive to the touching finger andignore then non-touching finger. Alternatively, the utilizationcircuitry may, for example, be differentially responsive to both thetouching and the non-touching fingers and utilize their positions and/ormovement to actuate different functionalities.

Reference is now made to FIGS. 23A-23E, which illustrate desktop userinterface functionality of an integrated display and input deviceconstructed and operative in accordance with a preferred embodiment ofthe present invention. Preferably the integrated display and inputdevice is a mobile computer and/or communicator 1600 constructed andoperative in accordance with the teachings of one or more of thefollowing applicants'/inventors' patent documents: Published PCT PatentApplications: WO 03/104965 A2 and WO 2005/094176 A3, U.S. ProvisionalPatent Application No. 60/715,546, filed Sep. 8, 2005, entitled OPTICALSENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional PatentApplication No. 60/734,027, filed Nov. 3, 2005, entitled CONTROLAPPARATUS; U.S. Provisional Patent Application No. 60/789,188, filedApr. 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES, U.S.Provisional Patent Application No. 60/682,604, filed May 18, 2005 andentitled NOVEL DISTORTION LENS and U.S. Patent Application PublicationNo. 2005/0156914A1, the disclosures of which are hereby incorporated byreference.

Preferably the mobile device includes a display screen 1602 having touchresponsive input functionality and/or propinquity responsive inputfunctionality, as described hereinabove particularly with reference toFIGS. 20A-22, and user interface function selection functionality whichis responsive to inputs received from the touch responsive inputfunctionality and/or propinquity responsive input functionality. Akeyboard 1604 may be provided as part of the integrated display andinput device but may be obviated in accordance with a preferredembodiment of the present invention.

FIG. 23A shows a finger 1606 located adjacent keyboard 1604 and notadjacent display screen 1602, which display screen 1602, as describedabove, includes touch responsive input functionality and/or propinquityresponsive input functionality. In the arrangement shown in FIG. 23 A,display screen 1602 typically displays an array of application launchicons 1608.

FIG. 23B shows finger 1606 located at a first distance D1 from displayscreen 1602, such that the propinquity responsive input functionalitysenses finger 1606 in propinquity to display screen 1602 which definesan impingement area 1612 of light reflected from finger 1606 that isgenerally centered on a first application launch icon 1614, even thoughit may also partially impinge on other icons. The functionality of themobile device 1600 causes icon 1614 to appear in an enlarged orotherwise visually sensibly emphasized form, as indicated by referencenumeral 1616.

In accordance with a preferred embodiment of the present invention, asshown in FIG. 23C, when finger 1606 is located at a second distance D2from display screen 1602, which may be less than to D1, which preferablyis selected as a sub-icon presentation threshold distance SPT, thefunctionality of the mobile device 1600 causes sub-icons 1626, 1628 &1630 to appear, preferably in propinquity to the icon 1614 impinged uponby finger 1606.

FIG. 23D shows finger 1606 located at a third distance D3 from displayscreen 1602, which may be greater than or less than or equal to D2, suchthat the impingement area 1632 of light reflected from finger 1606 isgenerally centered on one of the sub-icons, for example sub-icon 1626.The functionality of the mobile device 1600 causes sub-icon 1626 toappear in a visually sensibly emphasized form, as indicated by referencenumeral 1634. This enables sub-icon 1626 to be readily identified by auser.

It is appreciated that the functionalities illustrated in some but notall of FIGS. 23A, 23B, 23C and 23D may be obviated in a system which isdifferentially responsive to touch and propinquity, but does notdistinguish between degrees of propinquity within a given threshold.

In accordance with a preferred embodiment of the present invention, asshown in FIG. 23E, when the finger 1606 touches the display screen 1602,a selection function is actuated, which may be considered akin to theclick of a conventional mouse. Actuation of the selection function ispreferably accompanied by feedback to the user, such as visual, auditoryor tactile feedback.

In accordance with a preferred embodiment of the present invention,where an icon, such as icon 1614, launches an application at an initialor default launch stage, sub-icons, such as sub-icons 1626, 1628 and1630, may be used to both launch the application and to actuate a givenfunctional stage thereof. For example, if icon 1614 represents an emailapplication and if the user selects sub-icon 1626, as illustrated inFIG. 23E, the email application is launched and an email messagetemplate 1636 is displayed, as shown. It is appreciated that as shown inthe above example, a single finger movement from outside SPT to insideST can replace multiple touch engagements required by prior art devices.

It is appreciated that the functionality of FIGS. 23A-23E may beprovided and/or used alone or in combination with any other suitablefunctionality, such as any one or more of the other functionalitiesdescribed herein below with reference to FIGS. 24A-33G.

Reference is now made to FIGS. 24A-24C, which illustrate browsingfunctionality of an integrated display and input device constructed andoperative in accordance with a preferred embodiment of the presentinvention. Preferably the integrated display and input device is amobile computer and/or communicator 1700 constructed and operative inaccordance with the teachings of one or more of the followingapplicants'/inventors' patent documents: Published PCT PatentApplications: WO 03/104965 A2 and WO 2005/094176 A3, U.S. ProvisionalPatent Application No. 60/715,546, filed Sep. 8, 2005, entitled OPTICALSENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional PatentApplication No. 60/734,027, filed Nov. 3, 2005, entitled CONTROLAPPARATUS; U.S. Provisional Patent Application No. 60/789,188, filedApr. 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES, U.S.Provisional Patent Application No. 60/682,604, filed May 18, 2005 andentitled NOVEL DISTORTION LENS and U.S. Patent Application PublicationNo. 2005/0156914A1, the disclosures of which are hereby incorporated byreference. Preferably the mobile device includes a display screen 1702having touch responsive input functionality and/or propinquityresponsive input functionality, as described hereinabove particularlywith reference to FIGS. 20A-22, and user interface function selectionfunctionality which is responsive to inputs received from the touchresponsive input functionality and/or propinquity responsive inputfunctionality. A keyboard 1704 may be provided as part of the integrateddisplay and input device but may be obviated in accordance with apreferred embodiment of the present invention.

FIG. 24A shows a finger 1706 located adjacent keyboard 1704 and notadjacent display screen 1702, which display screen 1702, as describedabove, includes touch responsive input functionality and/or propinquityresponsive input functionality. In the arrangement shown in FIG. 24A,display screen 1702 displays a portion of a web page.

FIG. 24B shows finger 1706 located at a distance from display screen1702, such that the propinquity responsive input functionality sensesfinger 1706 in propinquity to display screen 1702 which defines animpingement area for light reflected from finger 1706, having a centerwhich preferably is indicated by a cursor 1734 or other visualindicator.

Preferably, in accordance with a preferred embodiment of the presentinvention, when the distance of the finger 1706 is less than or equal toa lock threshold, the screen view area is locked, for example as shownin FIG. 24B, and remains the same even if the finger 1706 issubsequently moved further away from the display screen 1702, or issubsequently located in a different direction.

In accordance with a preferred embodiment of the present invention, whenthe browser functionality is in a locked state, as describedhereinabove, if the cursor 1734 is located in propinquity to ahyperlink, as shown in FIG. 24B, the link may appear in a visuallysensibly emphasized form, as indicated by reference numeral 1746,enabling the link to be readily identified by a user.

In accordance with a preferred embodiment of the present invention, asshown in FIG. 24C, when the finger 1706 touches the display screen 1702,an additional selection function is actuated, which may be consideredakin to the click of a conventional mouse. Actuation of the selectionfunction is preferably accompanied by feedback to the user, such asvisual, auditory or tactile feedback.

When the finger 1706 touches the display 1702, the link may be actuatedand thus, for example, open a new web page, as shown in FIG. 24C, orlaunch a program or initiate a download or other functionality.

It is appreciated that some but not all of the functionalitiesillustrated in FIGS. 24A and 24B may be obviated in a system which isdifferentially responsive to touch and propinquity, but does notdistinguish between degrees of propinquity within a given threshold.

It is appreciated that the functionality of FIGS. 24A-24C may beprovided and/or used alone or in combination with any other suitablefunctionality, such as any one or more of the other functionalitiesdescribed hereinabove with reference to FIGS. 23A-23E and/or hereinbelow with reference to FIGS. 25A-33G.

Reference is now made to FIGS. 25A & 25B, which illustrate scrollingfunctionality of an integrated display and input device constructed andoperative in accordance with a preferred embodiment of the presentinvention. Preferably the integrated display and input device is amobile computer and/or communicator 1800 constructed and operative inaccordance with the teachings of one or more of the followingapplicants'/inventors' patent documents: Published PCT PatentApplications: WO 03/104965 A2 and WO 2005/094176 A3, U.S. ProvisionalPatent Application No. 60/715,546, filed Sep. 8, 2005, entitled OPTICALSENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional PatentApplication No. 60/734,027, filed Nov. 3, 2005, entitled CONTROLAPPARATUS; U.S. Provisional Patent Application No. 60/789,188, filedApr. 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES, U.S.Provisional Patent Application No. 60/682,604, filed May 18, 2005 andentitled NOVEL DISTORTION LENS and U.S. Patent Application PublicationNo. 200510156914A1, the disclosures of which are hereby incorporated byreference. Preferably the mobile device includes a display screen 1802having touch responsive input functionality and/or propinquityresponsive input functionality, as described hereinabove particularlywith reference to FIGS. 20A-22, and user interface function selectionfunctionality which is responsive to inputs received from the touchresponsive input functionality and/or propinquity responsive inputfunctionality. A keyboard 1804 may be provided as part of the integrateddisplay and input device but may be obviated in accordance with apreferred embodiment of the present invention.

As seen in FIG. 25A, when a finger 1806 is located in propinquity to thedisplay screen 1802, and is moved upward or downward along the page, asdesignated respectively by reference numerals 1834 and 1836, arelatively fast upward or downward scrolling function is provided. Asdiscussed above, the speed of the scrolling may be but need notnecessarily be dependent on the distance of the finger 1806 from thedisplay screen 1802, preferably such that when the finger 1806 iscloser, the scrolling is slower.

Turning now to FIG. 25B, it is seen that in addition to upward anddownward scrolling, side-to-side scrolling and diagonal scrolling mayalso be provided.

The speed of scrolling may be but need not necessarily be responsive tothe distance of the finger 1806 from the screen 1802.

It is appreciated that the functionality of FIGS. 25A and 25B may beprovided and/or used alone or in combination with any other suitablefunctionality, such as any one or more of the other functionalitiesdescribed hereinabove with reference to FIGS. 23A-24C herein and/or asdescribed herein below in reference to FIGS. 26A-33G. Reference is nowmade to FIGS. 26A, 26B, 26C, 26D and 26E, which are illustrations ofcontact management functionality of an integrated display and inputdevice constructed and operative in accordance with a preferredembodiment of the present invention. Preferably the integrated displayand input device is a mobile computer and/or communicator 1900constructed and operative in accordance with the teachings of one ormore of the following applicants'/inventors' patent documents: PublishedPCT Patent Applications: Published PCT Patent Applications: WO 03/104965A2 and WO 2005/094176 A3, U.S. Provisional Patent Application No.60/715,546, filed Sep. 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENTOF LIGHT SCATTERING; U.S. Provisional Patent Application No. 60/734,027,filed Nov. 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional PatentApplication No. 60/789,188, filed Apr. 3, 2006 and entitled USERINTERFACE FUNCTIONALITIES, U.S. Provisional Patent Application No.60/682,604, filed May 18, 2005 and entitled NOVEL DISTORTION LENS andU.S. Patent Application Publication No. 2005/0156914A1, the disclosuresof which are hereby incorporated by reference.

Preferably the mobile device includes a display screen 1902 having touchresponsive input functionality and/or propinquity responsive inputfunctionality, as described hereinabove particularly with reference toFIGS. 20A-22, and user interface function selection functionality whichis responsive to inputs received from the touch responsive inputfunctionality and/or propinquity responsive input functionality. Akeyboard 1904 may be provided as part of the integrated display andinput device but may be obviated in accordance with a preferredembodiment of the present invention.

As seen in FIG. 26A, a finger 1906, located at a distance CM1 fromdisplay screen 1902, such that the propinquity responsive inputfunctionality senses finger 1906 in propinquity to display screen 1902,which defines an impingement area 1908 of light reflected from finger1906 that is generally centered on a contact manager icon 1916.

The functionality of the integrated display and input device 1900 causesicon 1916 to appear in a visually sensibly emphasized form, as indicatedby reference numeral 1918. Similarly to that discussed hereinabove withreference to FIG. 23E, when, as shown in FIG. 26B, finger 1906 touchesthe display 1902, a selection function is actuated. For example, if auser selects icon 1916, the contact manager is launched. FIG. 26B showsthe result of selection of icon 1916. Zooming functionality may also beprovided. Additionally or alternatively, locking functionality of thetype described hereinabove with reference to FIGS. 24B and 24C may beprovided.

Additionally or alternatively, hyperlink functionality of the typedescribed hereinabove with reference to FIGS. 24B and 24C may beprovided.

Additionally or alternatively, tool bar/tab functionality of the typedescribed herein below with reference to FIGS. 27A-27D may be provided.Reference is now made to FIG. 26C, which illustrates highlighting acontact entry line by positioning finger 1906 such that the propinquityresponsive input functionality senses finger 1906 in propinquity todisplay screen 1902, when finger 1906 is located at a distance CM3 fromthe display screen 1902. FIG. 26D shows the finger 1906 located at thesame location and now located at a distance CM4 from display screen1902, which is equal to or less than a predetermined drop list thresholdDLT. This causes a sub-menu 1920 to appear on display screen 1902. Thesubmenu 1920 typically includes contact details corresponding to a givencontact entry line. These may include, for example, an email address, afax number, a mobile telephone number, a VoIP number and a home pageURL. Positioning finger 1906 at one of the items on the submenu 1920results in the highlighting of that item, as shown in FIG. 26E. If,while at the same location, finger 1906 is brought even closer to thedisplay screen 1902, such as to a distance CM5, equal to or less thanselection threshold ST, a function associated with that item isactuated. For example, if finger 1906 is located at an email address, anemail functionality is actuated and the email address is automaticallyinserted as designated by reference numeral 1922. As another example, iffinger 1906 is located at a telephone number, the telephone number isdialed.

It is appreciated that some but not all of the functionalitiesillustrated in FIGS. 26A-26D may be obviated in a system which isdifferentially responsive to touch and propinquity, but does notdistinguish between degrees of propinquity within a given threshold.

It is appreciated that the functionality of FIGS. 26A-26E may beprovided and/or used alone or in combination with any other suitablefunctionality, such as any one or more of the other functionalitiesdescribed hereinabove with reference to FIGS. 23A-25B and/or hereinbelow with reference to FIGS. 27A-33G.

Reference is now made to FIGS. 27A, 27B, 27C and 27D, which illustratetool bar/tab functionality, of an integrated display and input deviceconstructed and operative in accordance with a preferred embodiment ofthe present invention, in a web-browsing environment, such as thatillustrated in FIGS. 24A-24C. Preferably, the integrated display andinput device is a mobile computer and/or communicator 2000 constructedand operative in accordance with the teachings of one or more of thefollowing applicants'/inventors' patent documents: Published PCT PatentApplications: WO 03/104965 A2 and WO 2005/094176 A3, U.S. ProvisionalPatent Application No. 60/715,546, filed Sep. 8, 2005, entitled OPTICALSENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional PatentApplication No. 60/734,027, filed Nov. 3, 2005, entitled CONTROLAPPARATUS; U.S. Provisional Patent Application No. 60/789,188, filedApr. 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES, U.S.Provisional Patent Application No. 60/682,604, filed May 18, 2005 andentitled NOVEL DISTORTION LENS and U.S. Patent Application PublicationNo. 2005/0156914A1, the disclosures of which are hereby incorporated byreference. Preferably the mobile device includes a display screen 2002having touch responsive input functionality and/or propinquityresponsive input functionality, as described hereinabove particularlywith reference to FIGS. 20A-22, and user interface function selectionfunctionality which is responsive to inputs received from the touchresponsive input functionality and/or propinquity responsive inputfunctionality. A keyboard 2004 may be provided as part of the integrateddisplay and input device but may be obviated in accordance with apreferred embodiment of the present invention.

FIG. 27A shows a finger 2006 located at keyboard 2004 and not located atdisplay screen 2002, which display screen 2002, as described above,includes touch responsive input functionality and/or propinquityresponsive input functionality. In the arrangement shown in FIG. 27A, atone stage in a web-browsing environment, a tool bar 2050 including aplurality of icons, preferably including a zoom navigator icon 2052, isprovided. Other functional icons which may be provided include, forexample, an icon operative for restoring an image to full-page view, anicon operative for going back a page, an icon for going forward a page,an icon for navigating to a predetermined web page, an icon whichcreates a bookmark and an icon navigating to a selectable list ofbookmarked web addresses.

FIG. 27B shows finger 2006 located at a first distance D1 from displayscreen 2002, such that the propinquity responsive input functionalitysenses finger 2006 in propinquity to display screen 2002 which definesan impingement area of light reflected from finger 2006 which causes theappearance of icon 2052 (FIG. 27A) to be enlarged, as designated byreference numeral 2060.

In accordance with a preferred embodiment of the present invention, asshown in FIG. 27C, when finger 2006 is located at a second distance D2from display screen 2002, which may be less than to D1, the propinquityresponsive input functionality senses finger 2006 in propinquity todisplay screen 2002 and defines an impingement on a search engine tab,such as a GOOGLE® tab 2066 (FIG. 27B), causing the appearance of the tabto be enlarged, as designated by reference numeral 2068.

FIG. 27D shows finger 2006 touching display screen 2002. This actuatesthe functionality of the search engine tab 2066, which, for example,launches the GOOGLE search engine, as designated by reference numeral2070. It is appreciated that any of the icon and sub-iconfunctionalities described elsewhere herein may also be provided for toolbar or tab icons.

It is appreciated that some but not all of the functionalitiesillustrated in FIGS. 27A-27C may be obviated in a system which isdifferentially responsive to touch and propinquity, but does notdistinguish between degrees of propinquity within a given threshold.

It will be appreciated that the functionalities described above withreference to FIGS. 27A-27D allow icons or buttons to be unobtrusivelypresent when not in use, and grow and gain prominence in the display asdesired. At an intermediate zoom-in level, the icons are sufficientlyvisibly enlarged to enable greater user discrimination, and to determinemore easily if the icon does in fact represent the desired function.When fully zoomed, the icons are very usable. This also allows a greaternumber of functional icons to be practically available in a limitedspace.

It is appreciated that the functionality shown in FIGS. 24A-24C and27A-27D enables convenient viewing of a web page without requiringreformatting of the web page to optimally fit a mobile device orprovision of a pre-optimized web page.

It is appreciated that the functionality of FIGS. 27A-27D may beprovided and/or used alone or in combination with any other suitablefunctionality, such as any one or more of the other functionalitiesdescribed hereinabove with reference to FIGS. 23A-26E and/or hereinbelow with reference to FIGS. 28A-33G.

Reference is now made to FIGS. 28A and 28B, which illustrate additionalbrowsing functionality of an integrated display and input deviceconstructed and operative in accordance with a preferred embodiment ofthe present invention, in a web-browsing environment, such as thatillustrated in FIGS. 24A-24C and FIGS. 27A-27D. Preferably, theintegrated display and input device is a mobile computer and/orcommunicator 2100 constructed and operative in accordance with theteachings of one or more of the following applicants'/inventors' patentdocuments: Published PCT Patent Applications: WO 03/104965 A2 and WO2005/094176 A3, U.S. Provisional Patent Application No. 60/715,546,filed Sep. 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHTSCATTERING; U.S. Provisional Patent Application No. 60/734,027, filedNov. 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional PatentApplication No. 60/789,188, filed Apr. 3, 2006 and entitled USERINTERFACE FUNCTIONALITIES, U.S. Provisional Patent Application No.60/682,604, filed May 18, 2005 and entitled NOVEL DISTORTION LENS andU.S. Patent Application Publication No. 2005/0156914A1, the disclosuresof which are hereby incorporated by reference.

Preferably the mobile device includes a display screen 2102 having touchresponsive input functionality and/or propinquity responsive inputfunctionality, as described hereinabove particularly with reference toFIGS. 20A-22, and user interface function selection functionality whichis responsive to inputs received from the touch responsive inputfunctionality and/or propinquity responsive input functionality. Akeyboard 2104 may be provided as part of the integrated display andinput device but may be obviated in accordance with a preferredembodiment of the present invention.

FIG. 28A shows a finger 2106 located at display screen 2102, whichdisplay screen 2102, as described above, includes touch responsive inputfunctionality and/or propinquity responsive input functionality. In thearrangement shown in FIG. 28A, at one stage in a web-browsingenvironment, a selection box 2174 including a plurality of selections,preferably including a sports selection 2176, is provided. Otherselections which may be provided include, for example, a group offavorites or bookmarked web addresses.

As seen in FIG. 28A, finger 2106 is touching display screen 2102, suchthat the touch responsive input functionality senses finger 2106 andactuates the selection function, similar to the click of a conventionalmouse. Actuation of the selection function preferably loads the selectedweb page, as seen in FIG. 28B, or launches a program or initiates adownload or other functionality.

Alternatively, finger 2106 may be at a distance from display screen2102, such that the propinquity responsive input functionality sensesfinger 2106 in propinquity to display screen 2102 and actuates theselection function.

It is appreciated that the functionality of FIGS. 28A-28B may beprovided and/or used alone or in combination with any other suitablefunctionality, such as any one or more of the other functionalitiesdescribed hereinabove with reference to FIGS. 23A-27D and/or hereinbelow with reference to FIGS. 29A-33G.

Reference is now made to FIGS. 29A-29E, which illustrate documentviewing functionality of an integrated display and input deviceconstructed and operative in accordance with a preferred embodiment ofthe present invention. Preferably the integrated display and inputdevice is a mobile computer and/or communicator 2200 constructed andoperative in accordance with the teachings of one or more of thefollowing applicants'/inventors' patent documents: Published PCT PatentApplications: WO 03/104965 A2 and WO 2005/094176 A3, U.S. ProvisionalPatent Application No. 60/715,546, filed Sep. 8, 2005, entitled OPTICALSENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional PatentApplication No. 60/734,027, filed Nov. 3, 2005, entitled CONTROLAPPARATUS; U.S. Provisional Patent Application No. 60/789,188, filedApr. 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES, U.S.Provisional Patent Application No. 60/682,604, filed May 18, 2005 andentitled NOVEL DISTORTION LENS and U.S. Patent Application PublicationNo. 2005/0156914A1, the disclosures of which are hereby incorporated byreference.

Preferably the mobile device includes a display screen 2202 having touchresponsive input functionality and/or propinquity responsive inputfunctionality, as described hereinabove with reference to FIGS. 20A-22,and user interface function selection functionality which is responsiveto inputs received from the touch responsive input functionality and/orpropinquity responsive input functionality. A keyboard 2204 may beprovided as part of the integrated input and display device but may beobviated in accordance with a preferred embodiment of the presentinvention.

FIG. 29 A shows a finger 2206 located at a distance D1 from displayscreen 2202, such that the propinquity responsive input functionalitysenses finger 2206 in propinquity to display screen 2202 which definesan impingement area 2208 of light reflected from finger 2206 that isgenerally centered on one of the sub-icons, for example sub-icon 2216.

The functionality of the integrated display and input device 2200 causessub-icon 2216 to appear in a visually sensibly emphasized form, asindicated by reference numeral 2218. Similarly to that discussedhereinabove with reference to FIG. 23E, when, as shown in FIG. 29B,finger 2206 touches the display 2202, a selection function is actuated.

In accordance with a preferred embodiment of the present inventionsub-icons, such as sub-icons 2216, 2220 and 2222 (FIG. 29A) may be usedto launch a document viewing application showing varioususer-selectable, pre-selected documents. For example, if a user selectssub-icon 2216, the document viewer is launched and document associatedwith the selected sub-icon appears. FIG. 29B shows the result ofselection of sub-icon 2216. Zooming functionality may also be provided.

Additionally or alternatively, locking functionality of the typedescribed hereinabove with reference to FIGS. 24B and 24C may beprovided.

Additionally or alternatively, hyperlink functionality of the typedescribed hereinabove with reference to FIGS. 24B and 24C may beprovided.

Additionally or alternatively, tool bar/tab functionality of the typedescribed hereinabove with reference to FIGS. 27A-27D may be provided.Reference is now made to FIGS. 29C & 29D, which illustrate forward pageturning functionality which is preferably provided in accordance with apreferred embodiment of the present invention. As seen in FIG. 29C, whenfinger 2206 is located at a relatively large distance from the displayscreen 2202 such as D3, and is moved in a predetermined pattern such asa hook pattern, as designated by reference numeral 2230, a relativelyfast forward page turning function is provided, typically going frompage 1, as shown in FIG. 29B, to page 10, as shown in FIG. 29C.

As seen in FIG. 29D, when finger 2206 is located at a relatively smalldistance from the display screen 2202, such as D4, which is less thanD3, and is moved in a predetermined pattern such as the hook pattern2230, as illustrated, a relatively slow forward page turning function isprovided, typically going from page 1, as shown in FIG. 29B, to page 2,as shown in FIG. 29C.

It is appreciated that for distances between D3 and D4, a range ofdifferent speeds of page turning may be provided.

It is further appreciated that a similar motion in a different directionor a different motion may provide a different functionality. Forexample, as seen in FIG. 29E, a hook pattern designated by referencenumeral 2232 provides a backward page turning functionality. Thedistance difference functionality described above with reference toFIGS. 29C and 29D preferably also is operative for the backward pageturning functionality of FIG. 29E and other types of pattern dependentfunctionalities.

Finger motion pattern functionalities of the type described hereinabovewith reference to FIGS. 29C-29E may use any suitable type of patternrecognition software, such as, for example, Graffiti™, which iscommercially available from U.S. Robotics.

It is a particular feature of the present invention that, asdistinguished from the prior art, contact between the user's finger andthe screen is not required and both contact and non-contact positioningof a user's finger may be used to control one or more aspects of thefunctionality, for example as described hereinabove in FIGS. 29C and 29Dwherein the speed of page turning is dependent on the distance, if any,from the screen.

It is appreciated that the functionality of FIGS. 29A-29E may beprovided and/or used alone or in combination with any other suitablefunctionality, such as any one or more of the other functionalitiesdescribed hereinabove with reference to FIGS. 23A-28B and/or describedherein below with reference to FIGS. 30A-33G.

Reference is now made to FIGS. 30A, 30B, 30C, 30D, 30E, 30F, 30G and30H, which are illustrations of contact management functionality of anintegrated display and input device constructed and operative inaccordance with a preferred embodiment of the present invention.Preferably the integrated display and input device is a mobile computerand/or communicator 2300 constructed and operative in accordance withthe teachings of one or more of the following applicants'/inventors'patent documents: Published PCT Patent Applications: WO 03/104965 A2 andWO 2005/094176 A3, U.S. Provisional Patent Application No. 60/715,546,filed Sep. 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHTSCATTERING; U.S. Provisional Patent Application No. 60/734,027, filedNov. 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional PatentApplication No. 60/789,188, filed Apr. 3, 2006 and entitled USERINTERFACE FUNCTIONALITIES, U.S. Provisional Patent Application No.60/682,604, filed May 18, 2005 and entitled NOVEL DISTORTION LENS andU.S. Patent Application Publication No. 2005/0156914A1, the disclosuresof which are hereby incorporated by reference.

Preferably the mobile device includes a display screen 2302 having touchresponsive input functionality and/or propinquity responsive inputfunctionality, as described hereinabove with reference to FIGS. 20A-22,and user interface function selection functionality which is responsiveto inputs received from the touch responsive input functionality and/orpropinquity responsive input functionality. A keyboard 2304 may beprovided as part of the mobile device but may be obviated in accordancewith a preferred embodiment of the present invention.

FIG. 30A shows a finger 2306 located adjacent display screen 2302 at adistance VM1 from display screen 2302 such that the propinquityresponsive input functionality senses finger 2306 in propinquity todisplay screen 2302 which defines an impingement area 2308 of lightreflected from finger 2306 that is generally centered on a contactmanager icon 2316.

The functionality of the integrated display and input device 2300 causesicon 2316 to appear in a visually sensibly emphasized form, as indicatedby reference numeral 2318. Similarly to that discussed hereinabove withreference to FIG. 23E, when, as shown in FIG. 30B, finger 2306 touchesdisplay screen 2302, a selection function is actuated. For example, if auser selects icon 2316, the contact manager is launched. FIG. 23B showsthe result of selection of icon 2316, which is a contact word entryform.

Zooming functionality may also be provided. Additionally oralternatively, locking functionality of the type described hereinabovewith reference to FIGS. 24B and 24C may be provided.

Additionally or alternatively, hyperlink functionality of the typedescribed hereinabove with reference to FIGS. 24B and 24C may beprovided.

Additionally or alternatively, tool bar/tab functionality of the typedescribed hereinabove with reference to FIGS. 27A-27D may be provided.Reference is now made to FIG. 30C, which illustrates entry of a contactword, BURGER and locating finger 2306 at a distance VM2 from the displayscreen 2302. FIG. 30D shows finger 2306 located at the same location andnow located at a distance VM3 from display screen 602, which is equal toor less than a predetermined selection threshold ST. This causes aweb-like array of related contact identifiers to appear. The arrangementof contact identifiers is preferably of the type provided by ThinkMapInc. as described at www.thinkmap.com. The contact identifiers aretypically grouped as to their general relationship with the contactword. Thus Elizabeth Burger, Sally Burger, Nathan Burger, Jed Burgerappear as possibly related persons, and Burger King, McDonalds andWendy's appear as burger purveyors and Burger, Id.; Hamburg, Germany andBurger Ave., Passaic N.J., appear as geographical designations.

Positioning finger 2306 at one of the contact identifiers results in thehighlighting of that item, as shown in FIG. 30E. If, while located atthe same location, finger 2306 is brought even closer to the displayscreen 2302, such as to a distance VM4, a function associated with thatcontact identifier is actuated. For example, if the finger is located atBurger Avenue, as seen in FIG. 30F, Burger Avenue is placed at thecenter of the screen and arranged around it are contact identifiersassociated with Burger Avenue, such as the names of various businesseslocated on Burger Avenue, names of adjacent streets. The other contactidentifiers may still appear on the screen, typically in a very small,but zoomable, format.

Referring now to FIG. 30G, which shows finger 2306 touching BurgerAvenue on the screen of FIG. 30F which causes a function associated withBurger Avenue to be actuated. For example, as seen in FIG. 30G, thefunction is display of a map of Burger Avenue and the surroundingregion. It is appreciated that some but not all of the functionalitiesillustrated in FIGS. 30A-30G may be obviated in a system which isdifferentially responsive to touch and propinquity, but does notdistinguish between degrees of propinquity within a given threshold.

It is appreciated that the functionality of FIGS. 30A-30G may beprovided and/or used alone or in combination with any other suitablefunctionality, such as any one or more of the other functionalitiesdescribed hereinabove with reference to FIGS. 23A-29E and/or hereinbelow with reference to FIGS. 31A-33G.

Reference is now made to FIGS. 31A-31G which illustrate picture viewerfunctionality of an integrated display and input device constructed andoperative in accordance with a preferred embodiment of the presentinvention. Preferably the integrated display and input device is amobile computer and/or communicator 2400 constructed and operative inaccordance with the teachings of one or more of the followingapplicants'/inventors' patent documents: Published PCT PatentApplications: WO 03/104965 A2 and WO 2005/094176 A3, U.S. ProvisionalPatent Application No. 60/715,546, filed Sep. 8, 2005, entitled OPTICALSENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional PatentApplication No. 60/734,027, filed Nov. 3, 2005, entitled CONTROLAPPARATUS; U.S. Provisional Patent Application No. 60/789,188, filedApr. 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES, U.S.Provisional Patent Application No. 60/682,604, filed May 18, 2005 andentitled NOVEL DISTORTION LENS and U.S. Patent Application PublicationNo. 2005/0156914A1, the disclosures of which are hereby incorporated byreference.

Preferably the mobile device includes a display screen 2402 having touchresponsive input functionality and/or propinquity responsive inputfunctionality, as described hereinabove particularly with reference toFIGS. 20A-22, and user interface function selection functionality whichis responsive to inputs' received from the touch responsive inputfunctionality and/or propinquity responsive input functionality. Akeyboard 2404 may be provided as part of the integrated display andinput device but may be obviated in accordance with a preferredembodiment of the present invention.

FIG. 31A shows a finger 2406 located adjacent keyboard 2404 and notadjacent display screen 2402, which display screen 2402, as noted above,includes touch responsive input functionality and/or propinquityresponsive input functionality. In the arrangement shown in FIG. 31A,display screen 2402 typically displays an array of application launchicons 2408.

FIG. 31B shows finger 2406 located at a first distance PV1 from displayscreen 2402, such that the propinquity responsive input functionalitysenses finger 2406 in propinquity to display screen 2402 which definesan impingement area 2412 of light reflected from finger 2406 that isgenerally centered on a first application launch icon 2414, even thoughit may also partially impinge on other icons. The functionality of themobile device 2400 causes icon 2414 to appear in an enlarged orotherwise visually sensibly emphasized form, as indicated by referencenumeral 2416. In this case icon 2414 is a picture viewer applicationicon.

Similarly to that discussed hereinabove with reference to FIG. 23E,when, as shown in FIG. 31C, finger 2406 touches the display screen 2402,a selection function is actuated. For example, if a user selects icon2414, the picture viewer is launched. FIG. 31C shows the result ofselection of icon 2414, which is an array of picture thumbnails 2418.Zooming functionality may also be provided.

Additionally or alternatively, locking functionality of the typedescribed hereinabove with reference to FIGS. 24B and 24C may beprovided.

Additionally or alternatively, hyperlink functionality of the typedescribed hereinabove with reference to FIGS. 24B and 24C may beprovided. Additionally or alternatively, tool bar/tab functionality ofthe type described hereinabove with reference to FIGS. 27A-27D may beprovided.

Reference is now made to FIG. 31D, which illustrates highlighting one ofthe picture thumbnails by positioning finger 2406 such that thepropinquity responsive input functionality senses finger 2406 inpropinquity to display screen 2402, when finger 2406 is located at adistance PV3 from the display screen 2402, thus producing a slightenlargement of the picture thumbnail on which finger 2406 impinges andoptionally display an identifier of the picture thumbnail.

FIG. 31E shows finger 2406 positioned at the same location and nowlocated at a distance PV4 from display screen 2402, which produces yetfurther enlargement of the picture thumbnail 2418. Conversely, thetransition from the relative orientation of finger 2406 and the displayscreen 2402 in FIG. 31E to that of FIG. 31D creates zooming-out feedbackfor the user. It is appreciated that the ability to quickly enlarge andreduce pictures on the screen allows for rapid review of a large numberof possibly similar pictures without requiring individual selection andexit from each picture.

FIG. 31F shows the finger 2406 positioned at the same location and nowlocated at a distance PV5 from display screen 2402, which is equal to orless than a predetermined locking distance threshold LT, which locks theextent of enlargement of the picture thumbnail 2418 notwithstandingfurther movement of finger 2406. Preferably, a drop-down menu 2420 isdisplayed, providing options for various picture related functions, suchas sending via MMS, sending via email, printing and editing. Inaccordance with a preferred embodiment of the present invention, asshown in FIG. 31G when finger 2406 touches the display screen 2402, aselection function is actuated, which may be considered akin to theclick of a conventional mouse. Actuation of the selection function ispreferably accompanied by feedback to the user, such as visual, auditoryor tactile feedback. In accordance with the illustrated preferredembodiment of the present invention, when finger 2406 touches displayscreen 2402 at a menu item on the dropdown-menu 2420, the correspondingfunction is actuated. For example, if the printing function is selected,the picture is downloaded to a printer.

It is appreciated that some but not all of the functionalitiesillustrated in FIGS. 31A-31G may be obviated in a system which isdifferentially responsive to touch and propinquity, but does notdistinguish between degrees of propinquity within a given threshold.

It is appreciated that the functionality of FIGS. 31A-31G may beprovided and/or used alone or in combination with any other suitablefunctionality, such as any one or more of the other functionalitiesdescribed hereinabove with reference to FIGS. 23A-30G and/or hereinbelow with reference to FIGS. 32A-33G.

Reference is now made to FIGS. 32A-32H, which illustration interactivetelevision functionality of an integrated display and input deviceconstructed and operative in accordance with a preferred embodiment ofthe present invention. Preferably the integrated display and inputdevice is a mobile computer and/or communicator 2500 constructed andoperative in accordance with the teachings of one or more of thefollowing applicants'/inventors' patent documents: Published PCT PatentApplications: Published PCT Patent Applications: WO 03/104965 A2 and WO2005/094176 A3, U.S. Provisional Patent Application No. 60/715,546,filed Sep. 8, 2005, entitled OPTICAL SENSOR FOR MEASUREMENT OF LIGHTSCATTERING; U.S. Provisional Patent Application No. 60/734,027, filedNov. 3, 2005, entitled CONTROL APPARATUS; U.S. Provisional PatentApplication No. 60/789,188, filed Apr. 3, 2006 and entitled USERINTERFACE FUNCTIONALITIES, U.S. Provisional Patent Application No.60/682,604, filed May 18, 2005 and entitled NOVEL DISTORTION LENS andU.S. Patent Application Publication No. 2005/0156914A1, the disclosuresof which are hereby incorporated by reference. Preferably the mobiledevice includes a display screen 2502 having touch responsive inputfunctionality and/or propinquity responsive input functionality, asdescribed hereinabove particularly with reference to FIGS. 20A-22, anduser interface function selection functionality which is responsive toinputs received from the touch responsive input functionality and/orpropinquity responsive input functionality. A keyboard 2504 may beprovided as part of the integrated display and input device but may beobviated in accordance with a preferred embodiment of the presentinvention.

FIG. 32A shows a finger 2506 located adjacent keyboard 2504 and notadjacent display screen 2502, which display screen 2502, as noted above,includes touch responsive input functionality and/or propinquityresponsive input functionality. In the arrangement shown in FIG. 32A,display screen 2502 typically displays an array of application launchicons 2508.

FIG. 32B shows finger 2506 located at a first distance IT1 from displayscreen 2502, such that the propinquity responsive input functionalitysenses finger 2506 in propinquity to display screen 2502 which definesan impingement area 2512 of light reflected from finger 2506 that isgenerally centered on a first application launch icon 2514, even thoughit may also partially impinge on other icons. The functionality of themobile device 2500 causes icon 2514 to appear in an enlarged orotherwise visually sensibly emphasized form, as indicated by referencenumeral 2516. In this case icon 2514 is an interactive televisionapplication icon. Similarly to that discussed hereinabove with referenceto FIG. 23E, when, as shown in FIG. 32C, finger 2506 touches displayscreen 2502, a selection function is actuated. For example, if a userselects icon 2514, the interactive television viewer is launched. FIG.32C shows the result of selection of icon 2514, which is a televisionpicture. Zooming functionality may also be provided.

Additionally or alternatively, locking functionality of the typedescribed hereinabove with reference to FIGS. 24B and 24C may beprovided. Additionally or alternatively, hyperlink functionality of thetype described hereinabove with reference to FIGS. 24B and 24C may beprovided.

Additionally or alternatively, tool bar/tab functionality of the typedescribed hereinabove with reference to FIGS. 27A-27D may be provided.

Reference is now made to FIG. 32D, which illustrates highlighting alocation 2516 on the television picture by positioning finger 2506 suchthat the propinquity responsive input functionality senses finger 2506in propinquity to display screen 2502, when finger 2506 is located at adistance IT3 from the display screen 2502, thus producing a visiblysensible indication of that location. Preferably, the visibly sensibleindication only appears on regions of the picture which have aselectably actuatable functionality. The selectably actuatablefunctionality may be, for example, display of related information, suchas player statistics, enhanced detail, or a link to a related web site.

FIG. 32E illustrates additional functionality wherein an icon 2518 isvisibly or invisibly superimposed on the television picture andpositioning finger 2506 such that the propinquity responsive inputfunctionality senses finger 2506 in propinquity to display screen 2502at the location of icon 2518 and causes a drop-down menu 2520 to bedisplayed, providing options for various content related functions, suchas purchasing a product, placing a bet, recording content, requestingfurther information and linking to a related web site. In accordancewith a preferred embodiment of the present invention, as shown in FIG.32F when finger 2506 touches the display screen 2502, a selectionfunction is actuated, which may be considered akin to the click of aconventional mouse. Actuation of the selection function is preferablyaccompanied by feedback to the user, such as visual, auditory or tactilefeedback. In accordance with the illustrated preferred embodiment of thepresent invention, when finger 2506 touches display screen 2502 at amenu item on the sub-menu 2520, the corresponding function is actuated.For example, if the betting function is selected, a betting menu 2524appears, as shown in FIG. 32F.

FIG. 32G shows finger 2506 located at location 2516 and now located at adistance IT6 from display screen 2502, which produces enlargement of thetelevision picture in a way such that the impinged upon location remainsvisible. Conversely, the transition from the relative orientation of thefinger 2506 and the display screen 2502 in FIG. 32G to that of FIG. 32Dcreates zooming-out feedback for the user.

FIG. 32H shows finger 2506 located at location 2516 and at a distanceIT7 from display screen 2502, which is equal to or less than apredetermined locking distance threshold LT, which locks the extent ofenlargement of the television picture notwithstanding further movementof finger 2506.

It is appreciated that even though the interactive televisionapplication described herein is illustrated in the context of mobiledevices, it is equally applicable to stationary television receivers.The functionality of FIGS. 32A-32H enables interactive televisionoperation with a minimum or zero buttons on a user control.

It is appreciated that some but not all of the functionalitiesillustrated in FIGS. 32A-32H may be obviated in a system which isdifferentially responsive to touch and propinquity, but does notdistinguish between degrees of propinquity within a given threshold. Itis appreciated that the functionality of FIGS. 32A-32H may be providedand/or used alone or in combination with any other suitablefunctionality, such as any one or more of the other functionalitiesdescribed hereinabove with reference to FIGS. 23A-31G and/or hereinbelow with reference to FIGS. 33A-33G.

Reference is now made to FIGS. 33A-33G, which illustrate desktop userinterface functionality of an integrated display and input deviceconstructed and operative in accordance with a preferred embodiment ofthe present invention. Preferably the integrated display and inputdevice is a mobile computer and/or communicator 2600 constructed andoperative in accordance with the teachings of one or more of thefollowing applicants'/inventors' patent documents: Published PCT PatentApplications: WO 03/104965 A2 and WO 2005/094176 A3, U.S. ProvisionalPatent Application No. 60/715,546, filed Sep. 8, 2005, entitled OPTICALSENSOR FOR MEASUREMENT OF LIGHT SCATTERING; U.S. Provisional PatentApplication No. 60/734,027, filed Nov. 3, 2005, entitled CONTROLAPPARATUS; U.S. Provisional Patent Application No. 60/789,188, filedApr. 3, 2006 and entitled USER INTERFACE FUNCTIONALITIES, U.S.Provisional Patent Application No. 60/682,604, filed May 18, 2005 andentitled NOVEL DISTORTION LENS and U.S. Patent Application PublicationNo. 2005/0156914A1, the disclosures of which are hereby incorporated byreference.

Preferably the mobile device includes a display screen 2602 having touchresponsive input functionality and/or propinquity responsive inputfunctionality, as described hereinabove particularly with reference toFIGS. 20A-22, and user interface function selection functionality whichis responsive to inputs received from the touch responsive inputfunctionality and/or propinquity responsive input functionality. Akeyboard 2604 may be provided as part of the integrated display andinput device but may be obviated in accordance with a preferredembodiment of the present invention.

FIG. 33A shows a finger 2606 located adjacent keyboard 2604 and notadjacent display screen 2602, which display screen 2602, as describedabove, includes touch responsive input functionality and/or propinquityresponsive input functionality. In the arrangement shown in FIG. 33A,display screen 2602 typically displays an array of application launchicons 2608.

FIG. 33B shows finger 2606 located at a first distance MB1 from displayscreen 2602, such that the propinquity responsive input functionalitysenses finger 2606 in propinquity to display screen 2602 which definesan impingement area 2612 of light reflected from finger 2606 that isgenerally centered on a first application launch icon 2614, even thoughit may also partially impinge on other icons. The functionality of themobile device 2600 causes icon 2614 to appear in an enlarged orotherwise visually sensibly emphasized form, as indicated by referencenumeral 2616. In this case icon 2614 is a map browser application icon.

Similarly to that discussed hereinabove with reference to FIG. 23E,when, as shown in FIG. 33C, finger 2606 touches display screen 2602, aselection function is actuated. For example, if a user selects icon2614, the map browser is launched. FIG. 33C shows the result ofselection of icon 2614, which is an extremely general map or aerial view2620, such as a map of North America which may be superimposed over acorresponding satellite image. Zooming functionality may also beprovided.

Additionally or alternatively, locking functionality of the typedescribed hereinabove with reference to FIGS. 24B and 24C may beprovided.

Additionally or alternatively, hyperlink functionality of the typedescribed hereinabove with reference to FIGS. 24B and 24C may beprovided. Additionally or alternatively, tool bar/tab functionality ofthe type described hereinabove with reference to FIGS. 27A-27D may beprovided.

Additionally or alternatively, scrolling functionality of the typedescribed hereinabove with reference to FIGS. 25A and 25B may beprovided.

Reference is now made to FIG. 33D, which illustrates highlighting aregion on the map or image by positioning finger 2606 such that thepropinquity responsive input functionality senses finger 2506 inpropinquity to display screen 2502, when finger 2506 is located at adistance MB3 from the display screen 2502, thus producing zooming in onthe selected region of the map and optionally displaying appropriatetext or icons, which identify items of interest, such as for example,historical sites, gas stations and shops or tagged locations.

FIG. 33E shows finger 2606 located at the same location and at adistance MB4 from display screen 2602, which produces yet furtherzooming in. Conversely, the transition from the relative orientation offinger 2606 and display screen 2602 in FIG. 33E to that of FIG. 33Dcreates zooming-out feedback for the user. FIG. 33F shows finger 2606located at the same location and at a distance MB5 from display screen2602, which is equal to or less than predetermined locking distancethreshold LT, which locks the extent of enlargement of the picturethumbnail notwithstanding further movement of finger 2606. Preferably, adrop-down menu 2622 is displayed, providing options for variouslocation-related functions, such as dialing a telephone number of aplace of business indicated on the map, obtaining directions to ahistorical site, finding the closest gas station and obtaininglocation-dependent coupons or sales offers.

In accordance with a preferred embodiment of the present invention, asshown in FIG. 33 G, when finger 2606 touches the display screen 2602, aselection function is actuated, which may be considered akin to theclick of a conventional mouse. Actuation of the selection function ispreferably accompanied by feedback to the user, such as visual, auditoryor tactile feedback.

In accordance with the illustrated preferred embodiment of the presentinvention, when finger 2606 touches display screen 2602 at a menu itemon the dropdown menu 2622, the corresponding function is actuated. Forexample, if telephone dialing function is selected, a correspondingtelephone number is dialed. It is appreciated that some but not all ofthe functionalities illustrated in FIGS. 33A-33G may be obviated in asystem which is differentially responsive to touch and propinquity, butdoes not distinguish between degrees of propinquity within a giventhreshold.

It is appreciated that the functionality of FIGS. 33A-33G may beprovided and/or used alone or in combination with any other suitablefunctionality, such as any one or more of the other functionalitiesdescribed hereinabove with reference to FIGS. 23A-32H.

It is appreciated that the various embodiments of the present inventiondescribed hereinabove substantially enhance conventional touch screenfunctionality by adding another input dimension. The present inventionthus enables differentiation between various positions of a passiveobject, such as a user's finger, thus distinguishing for example betweena situation wherein a user's finger touches a screen and one or moresituations where the finger is within a propinquity threshold of thescreen. This can obviate the need for an active stylus and enable theuse of a passive stylus or finger control of various functionalities.

Particularly advantageous embodiments of the present invention enable afinger touch position to be distinguished from a finger propinquityposition. For example a finger propinquity position may be employed fora mouse over functionality, while a finger touch position may beemployed for a mouse click functionality. It is appreciated by personsskilled in the art that the present invention is not limited by what hasbeen particularly shown and described hereinabove. Rather the scope ofthe present invention includes both combinations and sub-combinations ofvarious features described hereinabove as well as variations andmodifications thereto which would occur to a person of skill in the artupon reading the above description and which are not in the prior art.

What is claimed is:
 1. An integrated display and input device, comprising: a pixel array configured to provide a visually sensible output; at least one sensor configured to sense at least a position of at least one object with respect to the pixel array when the at least one object has at least a predetermined degree of propinquity to the pixel array; circuitry configured to receive an output from the at least one sensor and to provide a non-imagewise input that is representative of the position of the at least one object relative to the pixel array; at least one IR illuminator for illuminating the at least one object when it has the at least a predetermined degree of propinquity to the pixel array; and wherein the at least one illuminator is further configured to function as at least one backlighting illuminator associated with the pixel array.
 2. An integrated display and input device according to claim 1, wherein the at least one illuminator is located in a plane coplanar with or parallel to the at least one sensor.
 3. An integrated display and input device according to claim 1, wherein the at least one sensor is configured to sense light reflected from the at least one object.
 4. An integrated display and input device according to claim 1, wherein the at least one object is at least one finger of a user.
 5. An integrated display and input device according to claim 1, further comprising utilization circuitry, wherein the circuitry configured to receive an output from the at least one sensor is coupled and configured to provide the non-imagewise input to the utilization circuitry.
 6. An integrated display and input device according to claim 5, wherein the utilization circuitry is configured to provide chording functionality.
 7. An integrated display and input device according to claim 5, wherein the utilization circuitry is further configured to distinguish at least between positions of the at least one object when touching and not touching the device.
 8. An integrated display and input device according to claim 5, wherein the utilization circuitry is further configured to distinguish at least between directions of motion of the at least one object towards and away from the device.
 9. An integrated display and input device according to claim 5, wherein the utilization circuitry is further configured to compute at least one characteristic of a trajectory of motion of the at least one object generally parallel to the pixel array, where the at least one characteristic includes at least one of location, direction, velocity and change in direction.
 10. An integrated display and input device according claim 5, wherein the utilization circuitry is further configured to employ a sensed distinction between instances when the at least one object touches and does not touch the device.
 11. An integrated display and input device according to claim 5, wherein the utilization circuitry is further configured to utilize differences in sensed relative positions of a user's fingers.
 12. An integrated display and input device according to claim 1, wherein one of: the at least one sensor comprises a plurality of detector elements arranged in a plane parallel to a viewing plane, and each of the pixel array and the at least one sensor comprise a plurality of elements arranged in parallel planes, parallel to a viewing plane.
 13. An integrated display and input device according to claim 1, wherein the at least one sensor is coplanar with the pixel array.
 14. An integrated display and input device, comprising: a pixel array configured to provide a visually sensible output; at least one sensor configured to sense at least a position of at least one object with respect to the pixel array when the at least one object has at least a predetermined degree of propinquity to the pixel array; circuitry configured to receive an output from the at least one sensor and to provide a non-imagewise input that is representative of the position of the at least one object relative to the pixel array; and wherein the at least one illuminator is located generally in a same plane as at least one backlighting illuminator associated with the pixel array.
 15. An integrated display and input device, comprising: a pixel array configured to provide a visually sensible output; at least one sensor configured to sense at least a position of at least one object with respect to the pixel array when the at least one object has at least a predetermined degree of propinquity to the pixel array; circuitry configured to receive an output from the at least one sensor and to provide a non-imagewise input that is representative of the position of the at least one object relative to the pixel array; and wherein the at least one sensor includes a detector assembly arranged at least one edge of a viewing plane defining plate.
 16. An integrated display and input device according to claim 15, wherein the detector assembly is arranged along the at least one edge of the viewing plane defining plate.
 17. An integrated display and input device according to claim 15, wherein the detector assembly comprises: a support substrate, and an arrangement of detector elements.
 18. An integrated display and input device according to claim 17, wherein the arrangement of detector elements comprises one of: a plurality of discrete single-element detectors; an integrally formed multi-element detector array, and a plurality of discrete multi-element detectors.
 19. An integrated display and input device according to claim 17, wherein the detector assembly further comprises a cover layer, the cover layer formed of a light transmissive material.
 20. An integrated display and input device according to claim 17, wherein the cover layer includes a field-of-view defining mask having light-collimating tunnel-defining apertures.
 21. An integrated display and input device according to claim 17, wherein at least one detector in the arrangement is configured to detect electromagnetic radiation at a baseline level and to sense a position of the object with respect to the pixel array and wherein the circuitry is further configure to provide the non-imagewise input according to location of at least one detector in the arrangement for which at least one of the amount of radiation detected and the change in the amount of radiation detected exceed a first predetermined threshold.
 22. An integrated display and input device according to claim 21, wherein the change in the amount of radiation detected results from at least one detector in the arrangement detecting reflected light from the object in addition to detecting the radiation at the baseline level.
 23. An integrated display and input device according to claim 22, wherein the reflected light propagates to at least one detector in the arrangement by at least one of: reflected light propagating within the viewing plane defining plate; reflected light propagating above the viewing plane defining plate; and reflected light being transmitted through the viewing plane defining plate directly to the at least one detector in the arrangement.
 24. An integrated display and input device according to claim 22, further comprising an illumination subassembly configured to provide illumination for augmenting the radiation at the baseline level, the illumination subassembly being configured to provide at least some of the radiation at the baseline level.
 25. An integrated display and input device according to claim 24, wherein the electromagnetic illumination subassembly forms at least part of a linear arrangement of display backlights underlying the viewing plane defining plate.
 26. An integrated display and input device according to claim 21, wherein the at least one detector in the arrangement is configured to detect radiation at the baseline level, sense the position of the object with respect to the pixel array and wherein the circuitry is further configured to provide the non-imagewise input according to a location of at least one detector in the arrangement at which the amount of radiation detected is below a second predetermined threshold.
 27. An integrated display and input device according to claim 26, further comprising a processing subassembly including: detector analyzing processing circuitry configured to receive detector outputs of individual detectors in the arrangement, to determine at least one of: whether the amount of radiation detected by the individual detectors exceeds the first predetermined threshold; whether the change in the amount of radiation detected by the individual detectors exceeds the first predetermined threshold, and whether the amount of radiation detected by the individual detectors is below the second predetermined threshold, the detector analyzing processing circuitry being further configured to provide detector analysis outputs for the individual detectors; array processing circuitry configured to receive the detector analysis outputs of individual detectors in the arrangement and to generate an array detection output therefrom, and position determining circuitry configured to receive the array detection output of the arrangement and to determine the position of the object therefrom.
 28. An integrated display and input device according to claim 27, wherein the array detection output includes information corresponding to at least one of the location of an impingement point of the object on the viewing plane defining plate and the location of the object relative to the viewing plane defining plate.
 29. An integrated display and input device according to claim 21, wherein the radiation at the baseline level is provided at least in part by at least one source of illumination external to the integrated display and input device, the at least one source of illumination comprising at least one of sunlight, artificial room lighting and IR illumination emitted from a human body.
 30. An integrated display and input device according claim 15, wherein the at least one sensor comprises a plurality of generally forward-facing detectors arranged about at least one edge of the pixel array.
 31. A position sensing assembly comprising: a plate defining a surface; at least one pixel array including a plurality of detector elements configured to detect electromagnetic radiation at a baseline level, the at least one pixel array being configured to sense a position of an object with respect to the surface according to locations of ones of the plurality of detector elements at which at least one of the amount of radiation detected and the change in the amount of radiation detected exceed a predetermined threshold, the at least one pixel array being configured to sense at least a position of at least one object with respect to the at least one pixel array when the at least one object has at least a predetermined degree of propinquity to the at least one pixel array; circuitry configured to receive an output from the at least one pixel array and to provide a non-imagewise input that is representative of the position of the at least one object relative to the at least one pixel array; and wherein the change in the amount of radiation detected results from ones of the plurality of detector elements detecting reflected light from the object in addition to detecting the radiation at the baseline level.
 32. A position sensing assembly according to claim 31, wherein the at least one pixel array is configured to sense light reflected from the at least one object.
 33. A position sensing assembly according to claim 31, further comprising utilization circuitry that is configured to provide chording functionality, and wherein the circuitry configured to receive an output from the at least one sensor is coupled and configured to provide the non-imagewise input to the utilization circuitry.
 34. A position sensing assembly according to claim 33, wherein the utilization circuitry is further configured to distinguish at least between positions of the at least one object when touching and not touching the device.
 35. A position sensing assembly according to claim 33, wherein the utilization circuitry is further configured to distinguish at least between directions of motion of the at least one object towards and away from the device.
 36. A position sensing assembly according to claim 33, wherein the utilization circuitry is further configured to compute at least one characteristic of a trajectory of motion of the at least one object generally parallel to the at least one pixel array and wherein the at least one characteristic includes at least one of location, direction, velocity and change in direction.
 37. A position sensing assembly according to claim 33, wherein the utilization circuitry is further configured to employ a sensed distinction between instances when the at least one object touches and does not touch the device.
 38. A position sensing assembly according to claim 37, wherein the utilization circuitry is further configured to utilize differences in sensed relative positions of a user's fingers.
 39. A position sensing assembly according to claim 31, further comprising a processing subassembly including: detector analyzing processing circuitry configured to receive detector outputs of individual ones of the plurality of detector elements, to determine whether at least one of the amount of radiation and the change in the amount of radiation detected by the individual ones of the plurality detector element exceeds the predetermined threshold, and to provide detector analysis outputs for the individual ones of the plurality of detector elements; array processing circuitry configured to receive the detector analysis outputs of the plurality of detector elements of a single one of the at least one pixel array and to generate an array detection output therefrom, and position determining circuitry configured to receive the array detection output of the at least one pixel array and to determine the position of the object therefrom.
 40. A position sensing assembly according to claim 39, wherein the array detection output includes information corresponding to at least one of the location of an impingement point of the object on the viewing plane defining plate; and the location of the object relative to the viewing plane defining plate.
 41. A position sensing assembly according to claim 31, wherein the position of the object comprises at least one of a two-dimensional position of the object, a three-dimensional position of the object and angular orientation of the object.
 42. A position sensing assembly according to claim 31, wherein the radiation at the baseline level is provided by at least one source of radiation external to the position sensing assembly.
 43. A position sensing assembly according to claim 31, wherein the at least one pixel array comprises a single pixel array arranged along an edge of the plate. 